It's quicker to change the direction in which your eyes are looking than it is to change desktop.
Peripheral context
Even with your two eyes, you can't focus on two separate screens at the same time. So by your previous statement, any monitor setup of more than one monitor would be senseless.