> Does it really even matter if you're sending them your credit card details anyway?

But are you sending them this info? I thought a lot of sites used third-party payment processors precisely in order not to handle this data themselves (and be liable for mishandling).