There’s two aspects to the question and the answer you get depends on which aspect you are emphasizing.

If it’s a practical question, then the answer is that it doesn’t matter. This is as close as we will get to intent from an LLM that it’s indistinguishable.

If you are looking for actual intent, this is not that. It’s pseudo intent. Decided by what the expected words that should be generated in that situation are.

The models didn’t intend to do anything other than create the next word based on previous words.

So the question is whether it matters to you if it is, or isn’t, a simulation.

In physical reality, intent is more complex than simply being a function of variables: the nature vs nurture debate comes to mind as an example of the multiple variables that drive intent.