Hacker News Reader

But OpenAI's model isn't open source, how would they distill knowledge without direct access to the model?

You don’t need direct access for LLM distillation, just regular API access.

ok I looked it up and have a better understanding now.