I try to do this, too, for the same reasons.
(Well, it's far from 100%, but I at least make a point to politely decline the higher-quality recruiting mails, like those that reference my work and get into specifics of the position. So far I haven't regretted it.)