To be fair to the GP, I've, for example, seen/heard my friends and acquaintances call people Nazis for condemning vigilante violence (e.g. "punching Nazis"), the Berkeley riots, and Antifa protests.

I think the sentiment GP is trying to communicate is that many seem to throw the label out there without any further investigation as to whether its justified.

As for the downvotes, it might be because your comment came across very hostile.

Also, I agree that it's easy to see that the Daily Stormer is neo-Nazi type stuff.