Except you may have to deal with the inconvenience of changing your credit card number.
Unless they stored the number and are using it at multiple "merchants", your bank can stop all transactions from them from going through. There's also virtual card services like privacy.com and those provided by multiple banks.