When humans see a face, we apparently focus on the eyes and the lips. Once, for a summer job, I worked with our school photographer retouching the scanned images of the incoming freshman class. For efficiency, we just blurred the images to obliterate any scanning errors, and then restored and hand-retouched only the eyes and lips. Subjectively, the difference between blurred and blurred-with-original-eyes-and-lips was astonishing, while the difference between original and BWOEAL was comparatively rather small. I would assume that human expression and human vision evolved in parallel, in a complimentary fashion.
This also explains why humans so easily find faces in inanimate objects, or in three-character sequences like :-) and ^_^. We're just highly tuned to recognize and parse very particular physical features.