actually distillation is without weights - you basically just need a black box teacher model.