I didn't always think that. Possibly my perspective has changed because I'm starting a family, and spending time with relatives and friends at home is vastly more important to me than going out on the town. You spend that time at your house, and if your house is a tiny apartment it sucks. Then you realize that you can't afford a house in the city on your $100k salary and it feels bad.
Some middle-income joe in Nebraska might make 1/2 of my income, but I bet he can afford a sweet house with lots of bedrooms for all his kids - something I can't afford. Who's the rich one?