Maybe I'm giving people too much credit, and I'm sick of arguing about this because, in my mind, seeing a bunch of swastikas isn't going to make me anti-semitic.
I even sometimes find it funny (especially when people draw the arms wrong); but maybe for others it really is just a way to spread their ugly hatred, and that's not at all what I'm trying to defend.
I think the problem with this argument is that we're both actually right, but only in certain situations.