My 2p:
I think sexism, racism, etc. is wrong. I think we all need to be more considerate.
But, I also think Linus should be allowed to be a total ass if he wants, and so can the others, if they really have the best interests of Linux in mind. You could argue that if they are being asses, then they don't, but some communities just have people with a rough way of dealing with others, e.g. drill sergeants in the Marines.
That said, you can allow people to be asses and still not allow sexist, racist, etc. remarks.