Even if you write off those deaths as irrelevant, it still costs money to adapt, as infrastructure has to be built or abandoned and rebuilt, and human capital has to be moved along with it.
As solar and wind and storage prices are are coming down fast there is good reason to expect the developing world to be able to largely be able to leapfrog fossil fuels and electrify without the expensive cost of building centralized power plants with sprawling networks of transmission lines, substations and local power lines stretching for thousands and thousands of miles zigzagging through the country side.
Same with electric cars. We are getting close to a day when electric cars will be on sale with 200+ miles of range for 22,000 that has 1/10th the cost to operate as a equivalent internal combustion engine.
The idea that fossil fuel consumption is neccessary for economic growth and standard of living is outdated. Many nations economies have already decoupled growth from fossil fuel consumption. Reducing co2 emissions while simultaneously growing their economies. Including the US.
I agree with you that there's a deep and fundamental coordination problem, which is why de facto I think technological solutions will be what have to save us. Which is basically putting many millions of lives at stake with a hope and a prayer, but that's the best we have.