I recall reading somewhere (Ringworld, perhaps?) that the explanation to the Fermi Paradox is that anyone who sticks their head up over the wall gets it shot off.

Fact is, the Universe would be a terribly lonely place if we were all alone. I suppose we're willing to risk destruction/enslavement by a superior or hostile alien civilization just to not have to exist all alone.