I don't have to tolerate speech from people who threaten my life or community. And I don't mean 'threaten' in the sense of holding an opinion I find disagreeableThen you should understand that when "threatening speech" is used to censor people on false pretexts, then this dilutes reasonable concerns about threatening speech. If one is really concerned about truly threatening speech, one should be actively calling out such abuses from one's own side. Also, what naturally goes with that, is the calling out of actual violence from one's own side.
This is also why civility is useful for the public discourse. It acts as a sort of "DMZ" wherein actual hostility is more readily visible. (And certain people on all sides of the public discourse should be called out in this regard.)