I think the point is fair. From the perspective of liberty, there's no government using aggressive force against you; this is a perfectly free-market phenomenon.

That said, that doesn't mean it's always moral. For example, I don't feel comfortable saying at my place of work (software engineer) that women are biologically different than men and this probably has a large impact on why the field isn't 50/50 men/women.

I think this is a perfectly reasonable position, yet there's no way I could say this at work. I'd lose my job, just like James Damore.

So, I don't think that what is being done is wrong in the political sense, but I do think unfair cancellations are unethical. I think it's fine to "cancel" people/businesses/organizations that cause or allow unfair cancellations to take place. I already quietly decline to do business with and lobby against companies that adopt "woke" postures.

I'm part of a silent majority that votes with their wallet, I suppose.