The "world" is voting against allowing large unchecked migration to drastically that scares people and/or changes their local areas in ways they are uncomfortable with first and foremost.
My neighbours are a good example. I live in the UK. My ex is black African, and I'm Norwegian. Our neighbours are far right.
Yet they've always been nice to us. If politics ever comes out, one of the first things that gets said is "but not you". They have black and asian friends, despite supporting a party that wants to deport all non-anglo-saxons. It's always about the scary "others" that they worry are stealing their jobs ("but not you") until they get to know they. People who meet them quickly recognise that, hence why they have friends who come to their house who you'd think might have wanted nothing to do with them.
It's not about race, or culture, or religion per se. It's that they're afraid of how change will affect them.
In the UK, we see this clearly reflected in voting patterns too: The racist and/or anti-immigration candidates do best in the areas with the lowest or very highest amount of immigration: The areas where this is an abstract fear and most people have no friends who aren't white-British, and the usually deprived areas where there's a core of poor white people feeling under siege.
The best way to counter these attitudes, it seems, is moderate levels of immigrants spread out more. Of course that would take a lot of investment in redistributing social housing and building more affordable housing in wealthier areas - ultimately this is a socio-economic problem first and foremost.