One thing I've noticed in all the debates around freedom of speech in the last decade is that literally nobody favors actual free speech. When freedom of speech touches some of the things you consider "sacred" or when it can make a noticeable dent in your wallet, people usually scream for restrictions.
It will be better to stop pretending that debates about free speech and hate speech are about principles and not just group signalling and power demonstrations. This will take the moral non-arguments (that are currently mostly advanced by those that call for direct government censorship, although historically that hasn't been the case) out of the equation.