In many ways LLMs are more in support of the Philosophical Investigations era understanding of language and less in support of the logical positivist understanding of language put forth my Frege...

Like, the Frege approach is like the symbolic AI approach... define the rules, derive the meaning from the rules.

The PI approach is like the LLM approach... derive the rules and meaning from "experiencing" the use of the language.

Eg, we don't need to define what a "game" is. We know when something is a game or not even if we can't come up with an explicit set of rules for defining all instances of what we would otherwise "feel" was a game.

I'm running low on blood sugar...