Whenever Anonymous attacks, one of the top posts is a reasonable argument such as yours here that it is not helping matters, and I pretty much always find myself in agreement (e.g. wrt SOPA/PIPA last year).
So I'm curious about:
"Most of the time the people who Anonymous give the stick to deserve it"
Who are you thinking of?