Explain the existence of a heavily militarized police force, then. And the war on drugs. And blue laws. And the existence of borders, and the notion of citizenship.
No, freedom has many limitations. Some of those limitations are justified by reducing or punishing harm to others. Some are justified by reducing or punishing harm to self. Some are naked authoritarianism.
We have a president who's a proud authoritarian who literally celebrates violence against the press and summary executions by the police. He's spreading virulent disinformation with the express intent to overrule the will of the people, and he's consistently signalling that insurrection is the remedy to his failure to do so. Does your "no 'buts' regarding freedom" go so far as to tear down democracy in favor of a would-be dictator's "freedom" to commit treason?