My biggest concern is a group of people who will be unimpacted are dictating terms to the rest of us. I feel there is a strong comparison between private gated communities and strong borders (not necessarily walls).
Basically gated communities shield you from some kinds of crime. If you think Mexican immigrants are causing lots of crime then you should also think people in Maine or Michigan shouldn't have much say because of the lower concentrations of immigrants there.