Hacker News Reader

Regurgitating training data trigram by trigram is not how human language processing works.

And how does it work, then?

Everyone shrugs and says, “nope, humans are different”. I’ve commented about 100 times recently asking for detail as to how human language / thought works, yet have not seen an answer.

We interpret what we hear, make a mental representation of that (incrementally; this process sometimes fails), which links to concepts, which in turn can link to memories, then "look for the answer" (if it's a question) by association and puzzling, the former is pretty quick, the latter slow, check if the answer makes sense, and formulate a reply. We can start formulating a reply from similarly formed structures while completing the thought, because we monitor our speech. When that happens, you often say "er..."

That's basic linguistics and cognitive psychology. Nothing an LLM has done has invalidated that.

You sure about that? The more I interact with LLMs and learn how they operate, the more it seems to me like people operate on very similar principles and algorithms with their use of language.

The "if it walks like a duck" school of ontology.

Reply on news.ycombinator.com