We have a water dispenser thing from Sparkletts, the kind that dispenses hot and super cold water. I try and drink from that water, seeing as it's much cleaner and all that jazz. But I will literally drink 5 glasses of that water, and still be thirsty as hell. Cold tap water, however, quenches my thirst with the first cup. Is this normal? Does this happen to any of you guys as well?

I know what you mean though. It's better that it happened a century ago, rather than last week. ;)
I think it all has to do with your own personal preference. I grew up drinking tap water.
Oh, and coffee xD