I'm not so sure. 80% of US homes have a clothes dryer [1], and about 80% of clothes dryers are electric [2][3][4].
The average American drives 40 miles per day, which takes about 10 kWh of electricity, which is about the same amount of electricity as two loads in a typical electric clothes dryer.
It is very common for the laundry room to be next to the garage (or for the garage to be the laundry room). So put your EV charger on the same circuit as the dryer. Then as long as you don't need to charge the EV at the same time you are running the dryer as far as your house wiring is concerned it is like you are running an extra two loads of clothes through the dryer every day.
I'd expect this also wouldn't be a problem for the existing electrical grid, because even though it is increasing how much total electricity that the house uses its at night when the load on the grid is low.
It may take a lot more electricians (and a lot of grid upgrades) to get everything off fossil fuels, but it seems plausible that we can get a large percentage of people who have houses where they can charge overnight off ICE cars without much upgrades.
[1] https://www.epa.gov/archive/epa/newsreleases/first-clothes-d...
[2] https://www.eia.gov/todayinenergy/detail.php?id=39293
[3] https://www.energystar.gov/sites/default/files/asset/documen...
[4] https://www.statista.com/statistics/220466/household-penetra...