I think that that the "they're destroying jobs" or even then "they're stealing intellectual property" argument overshadows or distracts from the more important issues. What really concerns me is the large scale erosion of truth and reliability. Codebases and the internet at large are being flooded with less and less accurate information, with more bloat, and with more errors that will exponentially increase as more and more is built on them.
Faulty decisions based on patterns (and prejudice) will be made by models trained on a mixture of truth and falsehoods. These decisions will affect, and even kill people. There have always been some people who choose quick results and productivity over truth, but now we are seeing a mass scaling and automation of this mentality. But when people just hear "they're taking jobs" it's easy to dismiss those with concerns as Luddites.