> Models are not 1.prompt->2.forward propagation->3.response->4.end.
> They are 1.prompt->2.forward propagation->3.partial response->if not done goto 2.-> end.
You know something else that follows the same pattern? Your A/C system.
1. set temperature ->2. Get diff of temperature -> 3. Response -> if not done go to 2. -> end
The difference is that both 2. and 3. are deterministic, while in the LLM case, it is statistical and textual.