First, the right to freedom of speech only enshrines a right which already existed and which the Founders wanted to ensure would be protected to the greatest extent possible. The free and open exchange of ideas in an open society. Because you cannot have open and honest debate without the free and open exchange of ideas.
Second, we have seen recently that, if someone dares say something that a particular group of people don't like, then they had better prepare to be doxxed, deplatformed, harassed, and for people to harass their employer until they are fired from their job. All while those harassers profess that "freedom of speech doesn't mean freedom from consequences".
Those "consequences" are nothing less than outright intimidation and suppression of the free and open exchange of ideas. And they can be just as damaging as arresting someone and locking them up.