The time for optimism has passed IMHO due to unresolvable gridlock and paralysis.

Residents don't want affordable housing (NIMBY), politicians can't use eminent domain or go against the NIMBY desires without getting voted out of office, businesses create the demand for local housing through refusing to support remote work, and the lack of government doing anything leaves few options, but to watch things burn from afar. Residents who flee have the chance of a better life elsewhere, albeit not in their first choice.

The best optimism available is to collapse the bubble that is Silicon Valley and get prices back to a reasonable value. Any software company looking to incorporate should stay out of Silicon Valley and San Francisco in particular.