Are the LLMs "watching" the action, or are they only apprised of previous action once it gets to them?
Or do you mean - each agent has a chance to think after every turn?
Your idea of having it being passed in real time and having the LLM create a chain of thoughts even if action is not on them is interesting. I'd be curious to see if it would result in improved play.