>It's a continuum that we are likely very low on.
This is said often, but there is no evidence for this. It's just a kind of cynical self-hatred.
A civilization that directly visits us, which would mean having some kind of interstellar travel, would be, yes, more intelligent. But we have no evidence of that. A civilization that has dispersed some kind of Von Neumann machine to watch over us, yes, would be more intelligent. But we have no evidence of that either.
I've seen a few (optimistic) calculations using the Drake equation that puts anywhere from 2 to 50 possible intelligent civilizations in our galaxy. Those are some seriously large error bars. Stretch this out into the total number of galaxies, then yes, I can easily see there being another intelligent civilization in the Universe. But interstellar travel is already difficult. I'm pretty sure intergalactic travel is more than "just a little bit harder." But to assume that it is likely that we are low down on the intelligence scale is utterly without basis. It's just as likely that we're the best the galaxy has seen thus far.