Nope. You just save a token for that transaction, and tell your processor you'd like to refund that transaction. They have the associated card on file, not you.