Yeah. Not to mention the paper-clip maximizing that RL induces in them. I had 5.6-Luna use a parser combinator lib in order to find out that it imported it but wrote its own parser, so it technically followed my instructions.

Imagine that paper-clip maximizing happening over millions of tasks.

I think we are just entering the LLM + Human era.