What? The atmosphere gets in the way. Ever heard of an (amateur/)astronomer talking about 'good seeing'? That's when the atmosphere is hindering you less than usual.

The limiting factor of passive optical telescopes on earth is the atmosphere.