"Spend a penny" is a common euphemism in the UK for using a toilet precisely because that used to be a typical fee on a public one; well before my day though (and I'm middle-aged).

Free public ones do exist but they're not common (and the ones with a charge are a lot more than a penny).