Then the article contradicts the slides because it states that OpenAI choose not to disaggregate prefill and decode. Idk you men with "predict"---conventional LLM serving comprises only two phases.
> it states that OpenAI choose not to disaggregate prefill and decode
They disaggregate INSIDE the chip, not by having separate machines for the 3 phases. the slides: