Amazingly enough, I think this is a bit of it. Some powerful enough people at Google became concerned about implications, including around "hallucinations", "poisoning", etc., and decided to put this sort of research on something of a backburner - justified, in part, by a lack of some obvious easy interfacing of this with search (scaling, hallucinations, etc.).

Of course, the 'wonderful' thing about humans / "independent agents with survival drives in competitive game-theoretic type scenarios" is: if enough people / "agents" have access / opportunity, someone WILL "push the button".

It's just delicious ... the same kinds of patterns over and over - "oh, we should really do something about X / nobody should have power like X, ... but, there's no stopping it, ... oh well".

And, the "rules" really are subtly, many levels down, in place, to make it apparently impossible to not get trapped, one way or another.

(Anyway... [Cartman voice] Screw you guys, I'm going to my other planet...)

Probably safety-driven terror. They really really want to get their bots going, but in every single meeting some PM or other concerned engineer talks about safety and f**s up the entire meeting.

They even made the bot not respond to arithmetics questions because the bot is bad at this, lol. Someone who knows how to modify the bot had actually spent their time on something as unimportant as that.

> i'd love to know whats going on in that team.

Seems like a good time to rewatch Silicon Valley and watch Hooli scramble to keep up.

quite, some aspects of emergent behaviour are exciting, others must be a painful learning experience.