Immigration can easily cover that though. If you can get past the widespread anti-immigrant sentiment.
At small scales you can have them give up their culture and assimilate but at replacement scales you just turn your country into a third world country. That's completely unacceptable.
One is invited, the other is unwanted.
No one wanted or invited any of that.