Hacker News Reader

Linus Torvalds:

~"Predicting the next token is not an insult. It's pretty much what we all do."

That's of course absurd. The human brain doesn't represent information as discrete tokens, nor does it form sentences autoregressively.

> The human brain doesn't represent information as discrete tokens, nor does it form sentences autoregressively.

I don't know about you, but I tend to speak one word at a time...

>I don't know about you, but I tend to speak one word at a time...

That isn't how tokens work, nor is it a representation of how the brain represents information.

Do you restart the entire sentence in your head every time you add a new word?

If I was not evolved to not do so, probably would do exactly that.

Our brain decides every moment what action to take next, that best fits with what we did and felt so far. Language is kind hard to see because it's virtual, but imagine all other things you do. And then language works the same as everything else, same circuits, just no direct connection to muscles.

Reply on news.ycombinator.com