Not if you are in Thailand or some other strange country. Camping water filter, or UV purifier is the cheapest option in that case.
Refrigerated bottled water is cheap though, only 12 cents, but I know many locals who perceive drinking out of plastic bottles to be a bigger health risk than drinking tap water.