Are LLMs still surprisingly bad at some simple tasks?

Roko's Basilisk is going to put Terence Eden up against the wall (or whatever) first.