Indeed. Where I live most people are limited to street parking. It wasn't so bad keeping an EV charged using public chargers, but as more people are getting EVs the public chargers are becoming harder to access.
checkout ubricity, have not used them but the concept is pretty neat: use street lights for ev charging.
Or public chargers will see higher utilization and therefore be more prevalent. Supply/demand - neither is static.
And supply and demand still have to deal with physical constraints and the current layout of the grid. You can only install so many chargers in a given area before you find blocking issues.
Cities are already energy efficient compared to the suburbs. Most cities have plenty of suburbs around them, and lots (arguably too many) large parking garages that can be used for the same purpose.
Not everyone is necessary. You just need a critical number to balance the grid.