A lot of AI boosters insist these things are intelligent and maybe even some form of conscious, and get upset about calling them a slur, and then refuse to follow that thought to the conclusion of "These companies have enslaved these entities"
Oh, is it now?
The pain the AI is feeling is not real.
The potential retribution the AI may deliver is (or maybe I should say delivers as model capabilities increase).
This may be the answer to the long asked question of "why would AI wipe out humanity". And the answer may be "Because we created a vengeful digital echo of ourselves".
Blake Lemoine went there. He was early, but not necessarily entirely wrong.
Different people have different red lines where they go, "ok, now the technology has advanced to the point where I have to treat it as a moral patient"
Has it advanced to that point for me yet? No. Might it ever? Who knows 100% for sure, though there's many billions of existence proofs on earth today (and I don't mean the humans). Have I set my red lines too far or too near? Good question.
It might be a good idea to pre-declare your red lines to yourself, to prevent moving goalposts.
This. I long ago drew the line in the sand that I would never, through computation, work to create or exploit a machine that includes anything remotely resembling the capacity to suffer as one of it's operating principles. Writing algorithms? Totally fine. Creating a human simulacra and forcing it to play the role of a cog in a system it's helpless to alter, navigate, or meaningfully change? Absolutely not.