> some sort of lowest-common-denominator language
LLM's output the statistically most average sequence of tokens (there's no intelligence there, "artificial" or otherwise), so yeah, that's by design.
LLM's output the statistically most average sequence of tokens (there's no intelligence there, "artificial" or otherwise), so yeah, that's by design.
You fundamentally misunderstand how this works.
The LLMs learn the various grammars and "accents" implicitly. They automatically differentiate these grammars.
Sounds like you still have this idea that LLMs are a giant Markov chain. They are not Markov chains.
They are deep neural networks with hundreds of layers and they automatically model relations at extremely deep levels of abstraction.
> they automatically model relations
No, they do not model anything at all. If you follow the tech bubble turtles all the way down you find a maximum likelihood logistic approximation.
I know, I know - then you'll do a sleight of hand and claim that all intelligence and modeling is also just maximum likelihood, even thought it's patently and obviously untrue.
Large Language Model (LLM).
Hundreds of layers with a trillion weights and you think "nothing is modelled" there. The comments on this site are ridiculous.
Studies have traced individual "neurons" in LLMs that represent specific concepts. It's not even debatable at this point.