Ask HN: Could ML train on the weights/outputs of other LLMs?

I'm just curious if anyone's thought to actually try having ml algorithms try and predict an output, instead of training from scratch.

it'd probably be the equivalent of chatGPT giving you binary code instead of the higher level code that compiles into the said binary, but I'm just curious if the patterns and similarities between the models could lead to a better and faster method.