It is upside down in the sense that if you built a lens system like the eye, the image produced would be upside down.
The system evolved that way so it is never set "incorrectly" or "expected" to be the other way.
The system evolved that way so it is never set "incorrectly" or "expected" to be the other way.