Turns out I was unwittingly put into a monthly plan, after an undisclosed-as-trial period with no refund. In order to cancel, I waited for about thirty minutes for an agent, then said "No, I would not like to continue" for another thirty minutes. These guys were ran by Experian.
I wonder how "chargeback" would be received by such a company.
Visit annualcreditreport.com for the real thing. They might still try to upsell you, but if you can resist that, it's legitimate.
So any time you run into an issue with a merchant, if they look like they are acting in bad faith, you should just chargeback and stop wasting your time.
Then, when / if they reply with whatever upsell they offer, I replied with - "I sent you this email on xx/xx/xxxx. Again I repeat, I want to cancel my account. If you charge me, I will raise this with my bank as an invalid transaction"
When I got charged, I printed off the emails (there were 3 incidents, 12 - 15 pages per incident) and I emailed this to the bank. Like magic! The bank reversed the transactions.
Keep the emails somewhere safe. If a collections agent were to call, I would supply them with the 12 - 15 pages.
Remember, when you initiate the chargeback, it is the vendors responsibility to prove you initiated the purchase. Not the other way around.