“Vote with your wallet” is very different than actively making sure everyone else’s wallet is shut for that business.
Cancel culture is not about your right to not do business with X, is about trying to destroy X just because you don’t agree with it.