I think the answer is in two parts. One, there is a political environment that is very much interested in preserving itself regardless of whatever so-called benefits could come from actually changing the world, and two the market isn't really some kind of god like oracle that always does the "right" thing.
I'll give you an example to better explain what I mean to say.
The Roman Empire had a lot of good things going for it. They had many of the necessary ingredients for an Industrial Revolution to take place more than a thousand years earlier. So why didn't it? Clearly there was a lot of money to be made in hindsight, but in their political environment it was never going to happen.
Rome, as impressive as it was, had a small political class of movers and shakers who owned most of the wealth, and to those people if given more money they'd just buy more farmland. That's it. Literally, to them, the Roman political elite, the only way to invest money was buy farms.
I think in today's day and age we're in a similar conundrum. Obviously it's more nuanced and sophisticated than where the Romans were at, but most of the people who have power today can't understand or imagine the benefit of improving the world. The market isn't magically selecting for those things because they are a large part of the market.