You’re the one making the logical leap claiming there’s thinking.
And yes, language contains a model of the world. And in so far as that’s compressed in a model, it has a world model. But its world model is static. Its weights don’t change when it gains experience, after its training period. To say that it’s “thinking” is bizarre when it remains untouched entirely by the process.