kNN needs to hold on to a complete copy of the dataset itself unlike a neural net where it's all mangled.