Yes, they pay sales tax. Not income or FICA.
That doesn't mean "yup, close the border", but we should still be careful about distinguishing the issues: yes, immigration may be below the optimal level, but it doesn't follow that illegal immigration is unproblematic in this respect.