It's a pretty simple problem with a pretty simple solution. The problem is that local city councils have restricted the freedom to build through excessive zoning laws and regulations in order to increase housing prices for their own private investment benefit.
The solution is to relinquish them of this self-interested tyrant-like overbearing power and set these policies on the national level - basically how Japan does it. The more localized the power, the more self-interest is going to favor a minority of private individuals at the expense of society.