Except the places in the UK where illegal immigrants, asylum seekers, and refugees, tend to congregate (cities) are the places with the lowest support for Farage etc.
I.e. people voting for Farage are not the ones living next door to asylum seekers.
Maybe it's different in the EU and US.
People see problems (mainly caused by the cost of housing) and hear people like Farage blaming it on the "small boats", and people on the other end of the spectrum blaming it on millionaire landlords.
The reality is it's not caused by the 3 asylum seekers per 10,000 people increasing demand, but instead by essential legal immigration (to perform jobs as the native workforce reduces in number) and crucially the inability to build enough houses for everyone.
This thus pushes up price thanks to the age old supply/demand curve. How else would we ration housing? Nepotism? Sexual favours? Lottery?