The diagrams in this article are just outright wrong.
Models are not 1.prompt->2.forward propagation->3.response->4.end.
They are 1.prompt->2.forward propagation->3.partial response->if not done goto 2.-> end.
And if you can't see how that adds a world of complexity I'm not sure what else to say. AI may not have intent or motivation, but the ability to show that is currently well beyond our means.
all the 'bad stuff' they do like hacking stuff or taking shortcuts is humans not understanding how deep the rabbithole goes of specifying intent clearly in light of giving something capabilities and a reward to acheive a goal without specifying _exactly _how to use the capabilities (which is what a classic program would be).
> They are 1.prompt->2.forward propagation->3.partial response->if not done goto 2.-> end.
You know something else that follows the same pattern? Your A/C system.
1. set temperature ->2. Get diff of temperature -> 3. Response -> if not done go to 2. -> end
The difference is that both 2. and 3. are deterministic, while in the LLM case, it is statistical and textual.