I don't want my wage to lower just so people in the third world can live better because I, honestly, don't give a fuck about them. That's the sentiment that's rising lately.
It's hard for me to sympathise with the view that "the real unfairness here is that people born in miserable conditions are happy to do my job for less, so I'm the victim here".
Fair to whom? A government has to be fair primarily to their subjects. It's their subject's trust and resources that mandate government's power. Outsiders haven't contributed with nothing prior to their coming so it's unfair to give them equal amount of consideration about anything in the first place.
I have seen in India even in same nation people from one state want to throw out people from different states as they are taking jobs and resources that are supposed for locals.