And, I would wager that there's a correlation between those who say there should be no limits on building, and those who are unwilling to pay for public infrastructure (schools, roads, transit systems, water and electric supply, etc.) needed to support the increased population.
The problem really is supply, and japanese zoning is objectively better for housing costs. Anybody who thinks that it is impossible for supply to keep up with boom time demand has no idea how much housing that developers are willing to build if we just fucking let them.
I've been thinking about this for a while, and I would really like to see the evidence for your view. What are the cities that have begun to suffer for lack of zoning (in this context, or otherwise)? Is this a modern problem? Is there a textbook example?
Google suggests Houston has a lack of zoning; interesting, but clearly it has been able to grow via sprawl.