>>nature alone manages to build towering long-lasting structures in that environment. Some of those redwood trees are older than the oldest buildings in the entire nation.
Yes, and they are continuously maintained by the living tree's processes, building everything from new roots, bark, branches and leaves. The question you need to ask is how long a dead redwood stays standing in the Pacific Northwest? What is the proportion of standing live to standing dead trees? How long does a fallen redwood trunk last, even starting out 20 feet thick?
>>The desert's evolved long-lasting structures are shrub-sized and endure by retreating underground
Yup, due to the same processes - the high heat and low humidity make very large transpiration loads, evaporating water very rapidly from the leaves, so tall structures with huge capillary capacity are unsustainable. It isn't because they wear out fast from the wind.
You seem to be mistaking attributes of biological growth processes for attributes of mechanical wear processes.