The trouble is that what is considered "violence" varies from person to person, and from ideology to ideology.
You don't have to protect the actual calls to violence. But if you don't protect the associated ideology, you're going to end up excluding basically all politics. I've never seen a large political movement that didn't contain a few bad actors promoting violence.
In the same way that gangsta rap music is protected, yes.