I'm no expert on LLMs, but I've always found the "it's just predicting the next word in a sentence" trope to be a huge misrepresentation of what LLMs are actually doing. To me this is a really cool example of how LLMs actually learn more than just simple word prediction and start to exhibit real intelligence for some tasks.