I find it pretty remarkable how in many visual recognition neural networks (say for the MNIST digits) you see neurons close to the input layer that respond similarly to neurons in the V1 area of the visual cortex.

http://www.lifesci.sussex.ac.uk/home/George_Mather/Linked%20...