I wish I were rich enough to distance myself from the noise of the riffraff. But with some 8 billion humans on the planet, that seems unsustainable.
Building with soundproofing in mind would be a good place to start. Asshole-proofing is trickier. There's nothing unreasonable about expecting people to behave in apartments (or elsewhere). Many (most?) places have laws about noise and nuisance, getting them enforced has not been easy in my experience.
Edit: 8+ billion people, apparently. I'm getting old.
It's been awesome for those six but in the last four, city construction and all the rest has come and ruined the noise.
The felling of trees near-by really ruined the peace.
If you want to never talk to neighbors, then don't have any. Sadly, this is becoming more and more of a luxury, particularly in areas with economic opportunity.