> the land they are built upon costs so much
The land costs so much because so many people want it. So many people want it because they want a place to live. If you build up, you provide places to live with less land, reducing demand on lane. It doesn't matter if it's high value condos being built, you're still providing an increase in the housing supply, which reduces prices for the entire market. If the high end market gets more supply, prices fall there, allowing more people access to that market- which reduces demand in the next-lowest band of prices, repeating the process.
I'm desperately trying to find the article I read on it but Portland is actually a shining example of this working. (Someone tell me I didn't make that story up in my head, because I swear I saw it here!). Portland allowed high end condos to go up and low-end rentals went down in price.
The problem is that NIMBYs elect politicians who won't allow real development, because they want their houses to be "investments". But you can't have housing be a "good investment" vs the market, with prices of housing constantly increasing faster than inflation, while also having your children buy houses at the same price (inflation adjusted) that you did.