It’s an interesting debate to bring up, but I think not really the same kind of prediction without explanation I am talking about.
The second post I linked turned out to be really interesting, it both aligns with my thoughts while also adding new ideas and concepts. It makes a distinction between GPT and the agents it simulates, the simulator and the simulacra.
A good enough simulator can simulate an entity capable of explaining lots of things, depending on the limits of the simulator.