That's a whole lot of traits and mindsets you've unfairly assigned to me.
And that's part of the perennial problem with discussion nowadays. It's near impossible to speak without being pigeonholed and caricatured : "omg! you dared to tangentially hint that prioritising building comes with some downsides! one of them! you must, therefore, also hold this, this, this, and this unfavourable worldview! how horrid you are!!".
It's all a bit silly. And ironic, because I'm actually disabled, and on a really tiny income within the scale of my country. I already make my difference by living a low impact life, practicing what I preach. I'm in my 40's and I've never owned a car, and it's not because I can't drive. I consume so much less than my countrypeople, in general in life. While my friend is earning, and consuming, $150K worth of "whatever" per year, goods, consumables, flights here and there for this and that luxury frivolity, raising his kids rich-person style, I'm living a simple life at home making a lot out of a little. There'll be no kids for me.
Screw the poor?? I am one of the poor. Regardless, I still see the basic Occam's reality that our species as it stands (and with massive inertia) is currently saturating this planet's resources in many different ways. And the mindset that we can fix everything by getting busy will always be somewhat paradoxical. Because, as you point out, everything we need is already right there, stockpiled in the hands of a greedy minority.