I wonder how well dataset distillation would work between NN <-> KAN. Could significantly reduce training time by seeding the initial KAN model, thus making more of these experiments feasible to conduct and thus can experiment on larger models.
No comments yet.