Because housing isn’t completely in-fungible either. So, while there might be irregularities here and there, increasing supply will in fact put downward pressure on prices.
https://news.ycombinator.com/item?id=28585422
You're grossly overstating constraints and the absolute and relative quantities of housing which must be added.