I have your policy, but for a different reason: I generally don't want the merchant to be charged a fee for the transaction.

Totally valid reason. I use cards for the sake of ease of tracking and protections offered by cards. I wish there were an optimal situation wherein you had privacy and protection both.