Unfortunately, I don't think it can be avoided - you can't have freedom of speech without having the worst of the worst be able to speak.
I dislike the people that support facist, racist beliefs, but I 100% will defend their right to say such things. In my opinion, once you start talking about restricting speech, you get into the grey area - who decides what speech to restrict? Off the top of my head, the most "capable" organizations would be either:
- The companies who run these glorified advertising platforms (which would regulate speech based on "how much money will we lose?"), or
- a Governmental body (which by its nature has a monopoly on violence - "if you say something we don't like, your social credit score goes down and you can't leave the country or we throw you in jail"). I think freedom of speech is a very large part of what makes America distinctive from other countries.
- Alternatively, we could have whoever the loudest complainers are control speech, which would be very reactionary - driven by misinformation or coordinated culture change campaigns(?)
If the people with abhorrent opinions decide to start causing direct physical harm to people in reality - that's when police, government, etc. should step in and penalize them - not social media companies or governments, or the vocal minority determining what people should and shouldn't say.