No, don't generalize like that. What you have to understand is that even as a percentage of the total population, immigration is only a problem in certain countries/regions mainly both because of failed immigration policies and also because the people there are plainly more racist/xenophobic.

I would put the slowing economic growth and aging population as more substantial EU-wide problems.