What Ilya says is that, the LLMs develop their own understanding of the world. They build their own model of the World.

And as of today, you can clearly see, this "model" is flawed, the LLMs understanding is flawed.