Some of those will have (or will have had) subcultures that generate self-replicating colonies, probes, or whatever. Those visit every stellar system in the galaxy in a very short time frame.
Possibly viable solutions include:
- We are simulated.
- Stochastic colonization leaves long-lasting uncolonized voids at all scales.
- Wolves. (Ecological wolves intent on making everything look natural, but since they get to be unitary, they can be as odd as they want to be).
But non-wolf Great Filter arguments have the same issues as arguing that all civilizations sublime, or leave, or whatever. There is always going to be someone who doesn't.