Exactly. The US basically had a huge forced immigration scheme a couple hundred years ago. Their descendants are still having a hard time in the US and it continues to be a huge issue for everyone involved, as recent protests show. Somehow, an even larger migration setup is going to work out smoothly?
Not to mention, if everyone could elect to move wherever they wanted: what % of the world's population would overwhelmingly choose West EU/US/Canada?
Even without the "burden of providing": Drive around Toronto and outlying areas and see, that even with Canada's still restrictive immigration policy, even across economic status, the idea that everything mixes into one cohesive society is laughably false.