My credit card web portal has a section for reversing transactions without having to call anyone. Maybe yours does too?
As long as you don't cancel, you do owe them money. But if they make cancelling intentionally hard, one would likely have a good case in court to still not pay, if one would want to go to court over this.