In the UK they were initially created by the temperance movement, I ended up starting this wiki article years ago. Sadly many are no longer functioning https://en.wikipedia.org/wiki/Metropolitan_Drinking_Fountain...
Also maybe less of an issue over here as you can generally just ask for a free glass of tap water in most places that serve drinks.
It's literally rule 0 of hospitality, to offer those in need a glass of water.
The only way it's awkward is if the place is very busy.