This explains it ( not sure about the diagram though ):

https://www.hardware-corner.net/multi-token-prediction-llm-s...