However, travel at 0.1c is not needed for the Fermi Argument to bite. Much slower speeds would allow a colonization wave to sweep a galaxy in time << the age of the universe.
I have three wild-eyed theories: (1) eukaryotism is an unbelievably exotic step; (2) and/or the moon is required and ultrarare; or, (3) advanced civilizations eschew yellow stars for being inconveniently short-lived: maybe they prefer brown dwarfs, white dwarfs, or black holes for their energy gradient.
We are simply the first.