Hacker News Reader

Comment by jquery | Hacker News Reader

What do you mean "just a text generator?" GPT-4 is capable of doing emergent things that were not present in the training dataset.

View on HN

I would like to see that topic covered in more detail. I can't see how something that essentially figures out what the next word should be can create something new, without actually understanding the real world.

I would recommend getting an account and simply testing it directly. It's fairly easy to demonstrate that it operates at a conceptual level and is not merely predicting word probabilities in a simplistic way.

A good example with GPT is to watch it do complex math. There are simply too many permutations of math solutions for it to have ever memorized, and it can easily explain its process and the path it took to arrive at a solution.

Another good set of tests are ones around theory of mind, complex deduction problems and missing information, etc. A good source of information about the precise capabilities of GPT-4 is the Microsoft Sparks paper, which goes into a good number of tests MS researchers put the model to.

Sabine Hossenfelder has a video that goes into LLM's ability to "understand"[0]. Stephen Wolfram also has one or two articles about GPT-4's emergent abilities.[1][2]

[0] https://www.youtube.com/watch?v=cP5zGh2fui0

[1] https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-...

[2] https://writings.stephenwolfram.com/2023/03/chatgpt-gets-its...

Reply on news.ycombinator.com