The usual advice is to boil the water if there is any doubt. For sediment, a coffee filter first wouldn't be a terrible idea.
Edit to add: immediately after an event, if you have a tank water heater, the water in the tank was already there. If you shut off the intake valve and turn off the heater, you have enough drinking water to last for a couple of weeks. Assuming you can get a container under the drain valve on the side. Triple check you have turned off the furnace before draining any significant amount water!
Have water on hand beforehand! It's not like bottles of water aren't for sale everywhere.
We've got a small collection of life straws/survival supplies for tramping, which is good, but they're in a part of the house that'd be inaccessible in a major event :/.