The thermodynamic argument seems much more important to the Fermi Paradox than any difficulties in refining material, but I don't think I understand it.