Striving for keeping the homogeneous culture that has existed for centuries and ejecting those who do not accept it is a reasonable alternative.
If this is the baseline level of Othering involved in the thinking around this, you understand why people view this as an expression of anti-semitism. “Respect other people’s cultures and beliefs, unless they’re Jewish” isn’t a good look for the left wing.
Look at ex-Yugoslavia. Is it not working out? Are the people worse off in their separate countries, than when they were genociding each-other under a common flag?
"Good fences make good neighbors" wasn't invented out of thin air.