Unless your vacation home is off grid, there is almost no way you would not be able to have enough electrical service to charge an EV. Maybe not enough to install a big chunky 50-60A 240V outlet, but a much smaller and reasonable 240V 20A outlet is more than sufficient for most cars. You won’t have a full charge overnight with a 3.8kW charger, but it’ll be plenty usable for putting around town.
Also, your anecdote is certainly not the plethora of people in America. The vast majority of folks take maybe one vacation a year, if that, and certainly don’t own a vacation home.