CO2 in the air is damaging all life on earth, while a lithium mine at most damages the local area around the mine. It's probably much better to have a few local "dead" spots than a complete planet out of whack.

And as a sibling comment said, lithium can be recycled.