The ability of LLMs to solve problems is not confined to the training data they ingested. Claude knows how to read mathematical papers because of its training data, but it can and will pull in literature relevant to a specific problem into its context.

We really need to stop thinking about LLM training data as the knowledgebase they build from and instead consider it more the skillset they start with.