I forget where, but someone from OpenAI said that that the next GPT is "all about the data".

I wonder if you have pre-training data that is fully factual, high quality, with perfect logic will result in a LLM that doesn't fall into reasoning gaps humans fall into.

Or are these reasoning gaps an innate component of intelligence?

Probably the most exciting thing about AI development is we get to start testing the things that make us uniquely human.