One argument I hear is that Islam is fundamentally incompatible with the West's values, that immigrants from those countries don't integrate well, and that the dangerous ideas within Islam aren't limited to radical fundamentalists. Under this view, a temporary ban is not necessarily a bad idea, nor is it necessarily racist except in the literal sense.
I disagree with this — I think the perfectly reasonable people from those countries need to be shown compassion, not to be lumped in with their oppressors — but the discussion should be about that, not who can scream "racist" louder.