The fact that potable water is so cheap in the developed world that you can use a gallon of it to flush your toilet is a miracle of civilization. Filter it if that makes you feel better, but it's a waste of money, and a dismissal of a major achievement in public health.
But hey, at least it's not bottled water, which is basically tap water that has been put in a single-use plastic bottle and trucked across the country.