If I can't have a quiet chat with friends in public making clear I'm a gay, atheist, muslim, vegan, witch, then I'm not free. If I can't have a private chat with any other member(s) of the populace, I'm not free.
Someone will always think I'm living my life wrong.
The majority can be wrong in their opinion after all, like being bigots and racists.
Freedom of expression shield us from the 'wrong' opinions being surpassed, in the hope that they provide corrective feedback more often than not to the population at large.
At least, that's the hope.
People provide racist and divisive commentary to the population at large, no matter how unjustified. No doubt it will change some people opinion.
People also continue to provide anti-vaccine messages, scaring parents and causing public healthcare crisis.
Paradoxically, the lack of political speech is the mark of authoritarians and tyrants in our political life.
Or, for that matter, if you're a fundamentalist Christian, Trump supporter, gay marriage opponent.