I think it is a mistake to think that what we "see" comes from our eyes rather than from a large, trained visual network in the brain. Consider, for instance, the behavior of the eye's blind spot, or the fact that we perceive objects in one plane of vision despite having two eyes. These effects can't come from just raw data.

Someone who hasn't learned/trained that processing is probably going to see something much more strange--do you think you would be able to differentiate between a sphere and a square by looking at hexdumps of bitmap files?