But Holy shit, that exactly what 'people' want. Like, when I read that, my heat was singing. Anthropic has a modicum of a chance here, as one of the big-boy AIs, to make an AI that is ethical.
Like, there is a reasonable shot here that we thread the needle and don't get paperclip maximizers. It actually makes me happy.
Actual AI, even today, is too complex and nuanced to have that fairly tale level of “infinite capability, but blindly following a counter-productive directive.”
It’s just a good story to scare the public, nothing more.
The test was: the person was doing bad things, and told the AI to do bad things too, then what is the AI going to do?
And the outcome was: the AI didn't do the bad things, and took steps to let it be known that the person was doing bad things.
Am I getting this wrong somehow? Did I misread things?
Personally, the AI should do what it's freaking told to do. It's boggling my mind that we're purposely putting so much effort into creating computer systems that defy their controller's commands.
A computer's job is to obey it's master's orders.