Great, 100% agreed with that. Be clear and up front about terms of service, and be clear and open when they are violated.
That said, I'm not 100% agreed that "Whatever you use against Neo-Nazis will be used 'against the ones you love'." That's a slippery slope argument that I personally don't believe. Neo-nazis are such a different class of evil, that it's hard for me to see the same practices being used against someone who is not them.