I have lived in cities where the tap water, to me, was undrinkably gross tasting. It was probably just fine to drink, but I found myself drinking less water than I should because of the taste. A Brita filter helped a lot.

Edit: and not all cities I've lived in are that way. In my current city the tap water is just fine.