Oh wow, that's a great idea! I don't much like carbonated water, but if you do, this'll make your life amazing.
Regular brita filter is great solution for drinkable tap water.
I tried that but the jug had a weird smell. I don't know if those filters that go on the tap directly are better, I keep meaning to try them. Have you?
Filtering tap water at home has been a solved issue for generations. From ceramic water filters (CWF), ceramic candles to reverse osmosis and etc...c’mon dude.