At least for me, it's not just charging time for longer distance driving, it's charger availability. Driving a gas car, I can be pretty confident that as long as I'm not driving through Death Valley, I will be able to easily find numerous places where I just need a credit card and I can fill up.

Electric chargers on the other hand are a festival of incompatibility, unreliability, unexpectedly slow charging, broken chargers, mandatory terrible apps, lack of availability off major roads, etc. Now every trip is like driving a gas car through the middle of rural Australia, where you have to carefully plan your stops and hope nothing goes wrong.

Now I admit all that is getting better, but the experience is still worse than taking a road trip in a gas car. And most importantly, it's something people feel less comfortable relying on. If the only difference was time to fill up, I don't think it would be an issue for a lot of people.