Dorian Abbot is a perfect example of why you're wrong.
He opposes affirmative action and as a result got cancelled at MIT for a _completely_ unrelated talk about climate and life on other planets.
If you yourself disagree with him and do not want to participate in the talk, fine. don't watch it, don't listen to it, don't attend it, and use YOUR speech to recommend others do the same.
What happened here is that he got cancelled so that those who _WANTED_ to associate no longer could. This is not about association, and it's not about speech, it's about preventing others from hearing and it's about harming him for daring to have that opinion.
When the cancel culture stops happening, THEN I'll start believing when people say the things you're trying to say here. Not before.