Not every single one of these cars needs to be charged all the time - and in any case, most people drive short enough distances that they can be charged at a simple 230V outlet over night, which means it would be enough to add outlets to existing street lights. Alternatively, employers, shopping malls etc. can provide charging opportunities in the exact same way. The only place where high-power chargers are needed is for people commuting long distances.
In any case, the goal should be to take as much individual car traffic off the streets as possible by providing usable and affordable mass transit as well as usable bike infrastructure.