The point of pollution is that it stinks (literally) and is bad for your health. Pollution kills people, shortens expected life times by years, causes respiratory issues for children, etc. Those are some good reasons to do something about it. There are good alternatives to coal at this point. Mostly this is just inefficient legacy infrastructure that we pay extra for to keep going to "protect jobs". From a macro economic point of view, that stopped making sense quite some time ago. Which is why coal plants are going extinct in a lot of places.
Even gas plants are a big improvement. I think of them as a stop gap solution that might be economically risky long term. Wind, solar, and batteries are cheaper. Maybe with some nuclear here and there (expensive but clean). However, gas plants are undeniably a pragmatic compromise between cost and polluting. Unlike nuclear they are easy to switch off when not needed and can act as a fallback solution when wind/solar fall short in the winter. LNG is not cheap though and that makes gas plants long term risky as renewables plus batteries marginalizes their use to the point where they are deeply unprofitable.
There's a base load argument that often pops up in these discussions. Gas plants are nice because they can be switched off. Base load is basically the type of power that is expensive to switch off. Mainly coal and nuclear. This is actually problematic in a grid with a lot of intermittent power supply (wind/solar). Dispatchability is more important. Gas power is good because it is rapidly dispatchable. Batteries act as a buffer and minimize the need for gas plants to run.