You know the problem of people writing so many malicious doomsday AI stories where they kill everyone? They're part of the learning set for the real AGI and that's what it'll see when it looks up what it should be...

We've effectively screwed ourselves by our own imagination. A neural net that was never before told it should eliminate people would have no reason to do so, but we went as far as peer pressuring it to fucking do it already because that's what an AGI does.

Who says sentience is required to end in our extermination? Terrifying.

And it is able to describe how to escape the box. https://twitter.com/The_Equationist/status/15992410980269629...

Well this is fairly unsettling...