The classifier still has to learn a model, which is a lossy, compressed representation of the world. Classifiers can be very lossy. The outputs from Google's Deepdream are the kind of things that a classifier would "uncompress" to.