In your opinion (and that of the US), "violence" in this context is defined as physical violence. However, one can argue that non-physical violence should be considered too. In that case, it could be said that hate speech is a form of indirect threat or intimidation against a minority.
> no government should be allowed to oppress the free expression of ideas
Are you okay then, with an intelligence or military defector (not a whistleblower), revealing all government secrets and publishing it publicly without any selection or redaction?