I'm not sure you are accepting the basic principle, which is that evolution is not in any way optimization (not that the evolutionary process is not "optimized").
See something like https://en.wikipedia.org/wiki/Fisherian_runaway
Also Giuseppe Longo's work on randomness as a cause of organizational complexity in evolution: http://montevil.theobio.org/en/system/files/articlepdf/Longo...
It's only when the environment changes (rise of mammals post dinosaur-extinction) or the organisms themselves change environment (Darwin's finches) that you get the rapid rates of evolution to find the new optimumm.
Some obvious analogies of these two situations in tech are the rise of the Internet (Microsoft did change, but struggled), and the rise of the smartphone (Apple came from nowhere to a position of dominance).