What about the charging infrastructure itself?
The first point in particular doesn't seem to get the attention it deserves.
As an example some places (try to) ban crypto mining because the extra power load effectively makes power more expensive for everyone.
The residential grid is built with a particular established demand for power. EV charging would significantly change that in many places.