I grew up in a fairly large house (I don't recall the size, but two floors, 6 bedrooms, kitchen, formal dining room, living room, family room, 3 bathrooms, basement filled with junk; so, fairly large -- semi-rural Maryland, where space was cheap in the 80s/90s). My parents weren't hoarders, though they did accumulate stuff. After my sister and I moved out and my mom passed away, my dad lived in a giant house by himself, couldn't maintain it, and also felt like he couldn't move because the house wasn't in good enough shape to sell.
I just don't get this need for more and more space. It just encourages you to buy more stuff that you don't need, and takes more time/effort/money to maintain. I hesitate to "tell people how to live", but this keeping up with the Joneses attitude is a component of what causes cost of living to rise and is ultimately a zero-sum game.