Just drink it straight. Municipal water (with few exceptions) is already filtered, treated, and regularly-tested for contaminants. It’s an insidious message from the bottled water industry that tap water is somehow poisonous without being filtered. It’s fine.
It’s practically a miracle that I can turn on a faucet anywhere in my state and feel safe drinking the water.