Came here to say the same thing. Models used to rely heavily on world knowledge from their training data. They are now much better at tool use and deciding when to research a topic, rather than just answering from memory.

I wonder how much that extends to using LLMs for programming. I assume most knowledge of programming language syntax still comes from training data.