No, it's not crazy or xenophobic. But it's interesting, because from a philosophical standpoint: what difference does it make? Why should you really help someone who lives down the street from you over someone 10 miles away? Why someone 30 miles away over someone 300 miles away? Because circumstance led you to randomly live near them?
Of course, the real answer is that it's hard to take in more people without externalities (like more splitting of funding, etc.). But the notion of helping your countrymen before non-countrymen on principle seems foolish and insular to me. People have feelings and desires whether they're born in the US or Canada or Iraq.