I'm saying this as someone who owns two electric cars. The infrastructure can be solved eventually, and some cities are looking into it, but even in the suburbs there are problems [2], which is why hydrogen is still out there as an alternative (albeit an immature and inefficient one), but for now, a large portion of the U.S. population cannot buy an EV.
[1] http://www.commerce.wa.gov/Documents/Demand-EVSE-Access-Gara...
[2] http://www.mercurynews.com/business/ci_24947237/charge-rage-...