The issue is ILLEGAL immigration. Musk is a legal immigrant. Trump's wife is a legal immigrant. My wife is a legal immigrant.
Few are actually opposed to legal immigration. Most either are legal immigrants, or descended therefrom just a few generations back. Yes there's a few marginal idiots, but they're ... marginal.