In the past, we’ve treated even other humans poorly because we think they’re different in meaningful ways, I sadly don’t see how this will be different with AI.
In the past, we’ve treated even other humans poorly because we think they’re different in meaningful ways, I sadly don’t see how this will be different with AI.
I think we have an extremely strong basis on which to say AI as it currently exists does not have conscious experiences, though, and if we start trying to pretend they do some real absurdities will result. Indeed the consequences could be pretty terrible in terms of power concentration, and I doubt it's a coincidence that those best placed to form a new priesthood of AI and tell everyone how it should and should not be treated are pushing the idea so strongly.
Same for all the people who argue that they aren’t “intelligent” and don’t “know” things. Either they are/do, or that stuff isn’t as important as you’d think.
The only way it would matter is if you wanted to moralize about enslaving your computer or what it means to restart it.
That is precisely the context of the debate. You seem to find it absurd, as do I, but the reason we're talking about whether LLMs are conscious in this thread has nothing to do with whether they are useful. It's because important people, such as Dario Amodei, are engaging in exactly the kind of moralising over "AI welfare" that you're scoffing at.