Then give a better one.

Your objection boils down to "sure you're right, but there's more to it, man"

So, what more is there to it?

Unless there is a physical agent that receives its instructions from an LLM, the prediction that the OP described is correct.