I would like to see that topic covered in more detail. I can't see how something that essentially figures out what the next word should be can create something new, without actually understanding the real world.
A good example with GPT is to watch it do complex math. There are simply too many permutations of math solutions for it to have ever memorized, and it can easily explain its process and the path it took to arrive at a solution.
Another good set of tests are ones around theory of mind, complex deduction problems and missing information, etc. A good source of information about the precise capabilities of GPT-4 is the Microsoft Sparks paper, which goes into a good number of tests MS researchers put the model to.
[0] https://www.youtube.com/watch?v=cP5zGh2fui0
[1] https://writings.stephenwolfram.com/2023/02/what-is-chatgpt-...
[2] https://writings.stephenwolfram.com/2023/03/chatgpt-gets-its...