Lack of housing is by policy. By ensuring there are not enough houses ensures there is more demand than supply, which means higher housing prices, which means higher mortgages. The mortgage market is based on rising house prices. The banking industry is based on the mortgage industry. Low house prices, would mean a falling mortgage market, which means a banking crises. Given that the banking cartel has more influence on politicians than the populous, we have this current state of affairs.
Remember, in the 1950s a new build home would cost about 1 years salary. Now one year's salary might only buy a nice car. Building technology hasn't gotten worse, it's much better and cheaper. It's not the construction companies that need disrupting.
Edit: Also I should say that that was the state of affairs until just recently. This recent move by Blackrock and the like is the prelude to massive inflation. They are abandoning paper assets (cash, equities etc) and investing in hard assets like housing, farmland and commodities.