> A 5% increase in supply annually indefinitely would crash the housing market there

Only if population is held constant.

Housing supply is inelastic, but housing demand is somewhat elastic. As seen in Denver, an increase in housing supply would decrease prices. But those lower prices will increase demand from people that want to live in Denver but previously couldn’t afford it.