So are you promoting no restrictions whatsoever? How close to violence do you want to allow? How allowable is a specific threat before it is actionable? How much intimidation is allowed to influence "free" action in your mind in the name of preserving "free speech" before it has too high a cost of preventing "free action"? How does something like fraud, or the slippier forms of it called "false advertising" or "hype" fit in?
We cannot be so paranoid about potential future government harms to us that we overlook the immediate dangers of current and ongoing harms done person-to-person.
If you extended the same level of paranoia to other abuses, you'd end up abolishing the police and any other sort of government body that could be abused as well... yet very few of us would choose that world. No world will be free of harm, free of crime, free of abuse of power - we must simply try to minimize their occurrence in practice vs trying to fit things into a slogan.