In the US, the problem with this as a solution if you had some contract or agreement with the company, simply not paying doesn’t mean you have cancelled that contract. They could continue to bill you, report non-payment to credit bureaus and try to come after you via collections.

Many/most won’t do all that but it is something to keep in mind.