For my million dollars I get to hear upstairs go the bathroom, my child gets woken up in the early hours by upstairs walking around in high heels after a night out. Every building on the street has a minimum of 6 - 8 apartments within so there's never any peace and quiet. Sometimes the bus has so many people I have to stand for nearly an hour.
Sometimes someone will crash on the bridge which will make me an hour late home which means I miss my kids going to bed. Mental health issues here are through the roof, the stress of high density living is literally killing people through depression and hypertension.
My child doesn't even know what a back yard is, that's a foreign concept to her. The only saving grace is that we're near to two beautiful beaches, without that I think I would have had a mental breakdown.
The whole "it'll only take a minute" issue that you seem to suffer from goes back to my cultural changes, one the culture has moved to work from home, the current working from home complaints will mostly be addressed. Also, let's not compare being in an office to going out for a drink, you can still go out and drink in your town with your friends in your community, again, cultural changes required.