Yes, but realistic plans for addressing climate change generally entail converting a lot of other activities to electric power; this is on the table for everything from transportation, to heating + cooking, to steel manufacturing. Not to mention carbon capture; many of the options there require a lot of energy. Even if some modes of transportation continue to require chemical fuels, we may be using electricity to produce some of those fuels.
It's reasonable to quibble at the margins, but in the big picture, we are going to need a LOT of carbon-neutral electricity and that is going to drive a lot (the solid majority?) of greenhouse gas mitigation.
> The counterpoint is electric vehicles. While these are generally a positive, they have more limited utility, higher cost (a significant issue in much of the world) and you have to factor in the externalities of the power used to charge them.
What point are you making with regard to externalities? Everything has externalities, you just need to add them into your calculus. Are you suggesting the externalities of electric vehicles imply that we should stick to fossil fuels for transportation?
As for higher cost: cost should continue to come down as we continue to climb the learning curve. I don't know if / when the lines cross (and of course it will be different for different use cases and locations), but again - if we're going to address climate change, we don't have a lot of choices; we will have to find a way to bring costs down and/or subsidize the higher cost.
"Limited utility" is absolutely going to be an ongoing challenge, but again it's not like we're helpless to do anything about it. More charging stations, longer range, possibly adjustments to usage patterns. In some cases, yes, we might need to stick to chemical fuels and find carbon-neutral sources, but this is not ideal and my expectation+hope is that it will eventually be very much a minority of usage.
I should note, I'm not advocating for nuclear power as the source of all this electricity we'll need; the feasibility of scaling nuclear power is a complicated topic and personally, I honestly don't know what to think or expect. The point I am trying to make is that a BIG part of "how to stop emitting GHGs" is going to boil down to "how to generate a stupendous amount of carbon-neutral electricity".