Then why can't we make sharp high resolution photos of distant planets? Shouldn't we be able to average out all the noise for every pixel if we just collect light long enough?
Exactly. The same pixel isn't imaging the same location on the distant object. If it were, then what you say might be possible.