if there is a potential for them to be intelligent and conscious, it's probably wrong to use them until we know for sure.
if aliens landed on earth and seemed a lot like us, we would have to grapple with the possibility that they might be conscious and deserving of the same moral consideration we give each other and many other animals.
but when meteors land, we don't have that concern
now are llms more like aliens or rocks?