Large language models can do jaw-dropping things. But nobody knows why. | Hacker News Reader

Large language models can do jaw-dropping things. But nobody knows why.

technologyreview.com

65 pointsbranko_d36 comments

> one of the biggest scientific puzzles of our time

> a hidden mathematical pattern in language that large language models somehow come to exploit... the fact that these things model language is probably one of the biggest discoveries in history

Is it? Excuse my ignorance. If we were talking about simple Markov chains, aren't these just stationary distributions?

Even if LLMs are thought of as Markov chains, there are still substantial unsolved scientific questions.

For a given prompt/"state", an LLM essentially computes the next-state probabilities. This is done by compressing language and storing particular patterns/distributions. To date, we still don't understand what statistics are stored by LLMs. Or even what stats might be necessary to produce natural-sounding language. (A canonical Markov chain only works with n-gram statistics, but we know these are insufficient.)

IMO figuring this out to a human-level understanding could be a major breakthrough in science. It would reveal a deeper structure to language. It may even help understand how our brains process language; we'll at least know one plausible algorithm. Prior to LLMs, many scholars assumed language was unique to the brain and could only poorly be "computed".

> Is it? Excuse my ignorance. If we were talking about simple Markov chains, aren't these just stationary distributions?

"- You're just a robot, you can't write a poem

- Can you?"

It seems that GPT3.5 is already a much better writer than I am, and I'm still much better than a Markov chain, so LLM's are verifiably better.

(Most) LLMs have been trained on more data than any human will ever be able to read, let alone process. Then they have been tweaked to produce human like output (most of the time). They can just as easily be tweaked to produce incomprehensible rubbish. This means that they can generate convincing human like output for any possible combination of data they were trained on and this output will usually be as good or better than that of average modern human that has consumed and comprehended tiny amount of data (in comparison). But even the dumbest of humans can be assumed to understand what they know where LLMs are just giant repository of numbers. LLMs have no capacity to understand what these numbers mean or what their output represents, that requires a human like intelligence. "AI" term has been grossly overloaded (just a couple of decades ago, a complex if/then/else statement was touted as "AI") and as we gain better and better understanding of information science, we assign that term to more sophisticated information systems we build but these systems are still far below of any threshold we would accept as sign of intelligence from another human being. Better term for these system would be Complicated Parrots rather than Artificial Intelligence. Intelligence requires understanding and understanding, I believe, requires sentience.

I find that most people have an incredibly hard time understanding the scale of an LLM's lexicon. I think that scale is always a struggle because it directly challenges our ability to comprehend beyond our own personal/tangible reference frame.

Had to press close on 4 popups before I could read anything and then another one as I quickly pressed the back button.

And why do you not have an adblocker installed?

I'm 100% behind ad blockers in a browser, but this is some grade A victim blaming right here.

This right here. I hate that we're at the point where blockers are absolutely required to use the internet comfortably.

Nobody wants to go near weeds. If ads were designed better we wouldn't be where we are now.

Bring back 10 second videos + skip - and relevant inline and non-manipulative ads and absolutely never endorse popups and we might have a fairer internet for content creators.

But here we are...

It boggles the mind that print media managed to make anonymous advertising work for the best part of 400 years, but somehow the advent of the internet means we're expected to believe that it's impossible to have ads that are topic-related, rather than viewer-related.

/shrug. Never saw any popups or anything. Just a flat page reads without any obstruction. Try a new add blocker.

Congratulations on completely missing the point and misspelling a two letter word at the same time. That's quite an accomplishment.

Congrats on being a jerk? I don't know man. Carry on.

Mobile?

Firefox on Android is a blessing.

You’ll be happy to learn there’s plenty of adblockers for both iOS and Android.

Can you point me to some which work on iOS? I don't want a separate browser though, I just want to use Chrome.

Rethink DNS from the F droid app store works pretty well.

It's not surprising that people don't know how GPT-4 works, because they don't have access to the model. Thus making it not an LLM but instead an API to a text generating oracle.

I believe the article discusses LLMs in general, not GPT-4.

> Large language models can do jaw-dropping things. But nobody knows exactly why. And that's a problem.

LLMs at least the most common ones can talk but they don't do things.

But even if they could. Humans can do it too, even your pet does jaw-dropping things. So far we never said that it's a problem in these cases.

So for me, such statements mostly communicate some sort of fear or skepticism. And I'm not saying that we shouldn't investigate why LLMs can do it. We should rather call it a research problem.

Yes, im sure OpenAI, and Google are paying incredibly high salaries to experts who dont know how LLM's work. I'm far from a computer scientist, or mathematician, but how the hell does this narrative keep being spouted by folks with a straight face? Oh, I know...no one can think critically...

No one knows how LLMs work in a sense that nobody knows how human brains work. Yes, we know a lot about individual cells, but the complexity that emerges when billions of them get connected is something that we do not understand. There is an argument that we'll never be able to fully understand our brain, because that would require more complex brain, which would make it more difficult to understand, which would require more complex brain etc...

Similarly, LLMs have "hidden layer". We know everything about individual "neurons", but we couldn't connect them together ourselves in a way that training somehow does. The network that is the result of that training is "hidden" from our understanding even though its individual nodes are plain to see.

Since AI can increase in complexity while human brain can't, there may come a day when AI understands the human brain, without the human brain ever being able to understand AI.

Reply on news.ycombinator.com