Yes I've noticed that many times people don't feel the need to defend other people's rights because it wouldn't also affect them directly.
I don't think it's my right to own all that. I don't need it. Someone else does. Unfortunately, they can't afford it and I can. Doesn't make it right.
It's also your right to give that property away if you like.
https://en.wikipedia.org/wiki/Right_to_property
Article 23 of the declaration states: “Every Person has the right to own such private property as meets the essential needs of decent living and helps to maintain the dignity of the individual and of the home.[10]”
-- This is not the case with real estate in America. It isn't dignified.