1. I highly suspect a pretrained-only model could not do this, yes.

2. Most problems anyone has are solved problems or variations on solved problems. This type of distillation is extremely useful.