The greatest cause of noise in cities is traffic. Setting a strict speed limit would substantially reduce this. (Also side benefits like better air quality and so on) And traffic would actually flow better, so you might not even reach your destination that much later.
You can be protect your individual freedom at all cost and treat everything as a zero sum game or you can bee cooperative and help build a better world for everyone by compromising a bit.
There are actual attempts to ban cars in my neighbourhood now because some people judge that the marginal effects of air pollution outweigh the enormous benefit of me being able to visit my friends and family in literally a quarter of the time.
These people don't think about benefit. It's only cost. I've come to think of them as simply being depressed, in the chemical imbalance sense.
I'm seriously surprised you haven't been downvoted off this thread.