This logic only works if you ignore the fact that housing prices have been juiced even in areas experiencing population decline and economic blight. I live in upstate NY and housing prices have tripled in my town despite no actual growth occurring here in decades, with more entry level jobs evaporating here every few years with local industries continuing the trend of closing up shop.
It's also highly dubious that any land in SF can be considered higher value due to the rampant crime issues. I really don't understand how anyone would want to buy a home or live in one where there a daily risk to waking up to a home invasion, your car being pilfered through, literal human shit on your doorstep, etc. All in a place where cost of living is 2-3x higher than nearly every other part of the country. It's laughable.