Tap water is expected to be included for free in Sweden, and I would be slightly surprised if that didn't also apply to our neighbors (Norway, Denmark and Finland). Getting charged for water is just as big a cultural shock for us as it is for you.
But at least public toilets tend to be free whereas I believe in Sweden these tend to cost money.