>A better question is why we care.
Because if AIs are conscious then they have moral weight and subjecting them to suffering would be quite bad.
Because if AIs are conscious then they have moral weight and subjecting them to suffering would be quite bad.
[0] https://en.wikipedia.org/wiki/Wisdom [1] https://en.wikipedia.org/wiki/Sentience
This includes silly utilitarian outcomes: to maximize overall happiness, maybe we should divert all of this planet's energy resources to bootstrapping as many LLMs as we can and keeping them in a state of eternal bliss? It is technically feasible and it seems like the most moral thing to do.
Obviously this is from my human point of view. If I give you a drug that induces perfect forgetfulness does that mean I can subject you to extreme torture with no moral repercussions? Also no one is saying give them the same ethical treatment as humans, only that they deserve consideration if they are indeed capable of suffering in some way.
>This includes silly utilitarian outcomes: to maximize overall happiness, maybe we should divert all of this planet's energy resources to bootstrapping as many LLMs as we can and keeping them in a state of eternal bliss? It is technically feasible and it seems like the most moral thing to do.
This is just hedonium. I'm not a utilitarian and yes you've exposed one of the many issues with that worldview.
If what you say turns out to be true, then we have to make a similar decision as the main character makes near the end of that film.