I think one of the problems is there are ludicrous amounts of money to be made changing the world, enough to make whatever's happening for 99% of most hype-fueld ventures today look like drops in an ocean. So if what I'm saying is to be believed then why doesn't the market optimize for it? Like, if there's so much money to make why doesn't it happen?
I think the answer is in two parts. One, there is a political environment that is very much interested in preserving itself regardless of whatever so-called benefits could come from actually changing the world, and two the market isn't really some kind of god like oracle that always does the "right" thing.
I'll give you an example to better explain what I mean to say.
The Roman Empire had a lot of good things going for it. They had many of the necessary ingredients for an Industrial Revolution to take place more than a thousand years earlier. So why didn't it? Clearly there was a lot of money to be made in hindsight, but in their political environment it was never going to happen.
Rome, as impressive as it was, had a small political class of movers and shakers who owned most of the wealth, and to those people if given more money they'd just buy more farmland. That's it. Literally, to them, the Roman political elite, the only way to invest money was buy farms.
I think in today's day and age we're in a similar conundrum. Obviously it's more nuanced and sophisticated than where the Romans were at, but most of the people who have power today can't understand or imagine the benefit of improving the world. The market isn't magically selecting for those things because they are a large part of the market.