People need a boogeyman because the real world is far too complex to comprehend, so having puppeteering bad guys is easier to deal with than reality of people actually having genuine beliefs that you don't agree with.
There definitely is some Antisemitism, though I don't think that's the main driver, the left also chastises Sheldon Adelson, who is also jewish.