He believes that he was able to get it to violate rules that they set by triggering a fight or flight response.
> I ran some experiments to see whether the AI was simply saying it felt anxious or whether it behaved in anxious ways in those situations. And it did reliably behave in anxious ways. If you made it nervous or insecure enough, it could violate the safety constraints that it had been specified for.
I'm not sure it's sentient but what even is sentience? Are there other non human levels of sentience? Are they a sentient mind that only produces a single thought? Does it matter? A developer, who works on it, believes it is so it's good enough to "trick" one if it's developers. I'm sure he won't be the last developer who is tricked. If developers who work on the thing are getting tricked then what chance does the public have?
What a strange machine we have constructed.