I wonder if part of the reason is that housing is not an investment vehicle in Japan (probably due to the Japanese preference for newer, more modern builds and the fact that housing is a depreciating asset in an earthquake prone region).
In most parts of the world, housing is tied to land, and land is very expensive. What makes things worse in North America is cultural dislike of verticality —- people want to preserve a museum of their low-rise neighborhoods and don’t want any tall buildings to block the view. That’s fine, but the cost is unaffordable housing.