I begin to suspect going nuclear is the only option.
"Hi, I'd like to cancel my service"
"But what about X?"
"Ombudsman and or Lawyers. Cancel. You have been instructed, the next time I say this will be in court/writing/etc".
In Australia, if you threaten to go to an ombudsman, companies tend to listen. Ombudsman cases are very expensive.