I mean if xenophobic is defined as preferring your own race compared to others then I guess pretty much the entire world is xenophobic except white liberals in western countries.
China or Japan doesn't (in recent decades at least) put nearly the same amount of effort into destabilizing other countries that they have no cultural affinity with compared to countries like the US.
To me, I would consider these actions more "racist" or "xenophobic" than restricting immigration to prevent excessive racial/cultural diversity. To me this is the rise and fall of nation states 101. More diversity in race and cultures leads to more conflict. You can't have a race riots between two races that don't live in the same nation.
To take this a bit away from race, just look at the middle east. Countries like iraq are doomed constant civil war because of the racial/cultural lines which are commonly expressed through religion sects. I think it would be pretty fair to say that without diversity, iraq as a nation would be much more stable and prosperous.
If it's xenophobic to understand race exists and the human condition is one that accepts race at a foundational level, then I guess we are all born Xenophobic. I personally don't believe in living by original sins.