I've always read the "great filter" as some kind of mass extinction. I just think that the Fermi paradox gained popularity when everyone thought that both our travel speeds and our population would continue to grow exponentially, making space colonization both inevitable and necessary.
What if we (and every other intelligent life) just level off when we start reaching the limits of physics and the available resources within our own solar system?