One word: cars.
No other explanation needed.
Car culture and car manufacturers' interests play a big part in the current inadequacy (by western standards) of the US infrastructure.
Tokyo is crammed and that's why trains work great over there. They wouldn't work in US city with suburban sprawl.