Sounds like speculative decoding.

https://huggingface.co/blog/vivien/optimal-lossy-variant-of-...