You're right, there's more to it. For instance, Tesla S with 75 kWh battery pack has the autonomy of, optimistically saying, ~400 km and the battery pack alone weighs 530 kg (!). This range is I think already within a 90th percentile for the EV cars currently on the market.

Now contrast that with basically any non-EV car whose tank capacity in average is 50-55 litres which is 10x less weight than the battery pack of the EV car. With pessimistic consumption of 7l per 100km you will have almost double the range of the 90th percentile EV vehicle or ~700 km. You will have none of the attached risks of the battery management (catching fire, deteriorating the capacity, replacing the pack in a few years) and you can top your fuel within minutes and literally anywhere.