Please just set up some sort of robots.txt related thing.

E-mailing every single company that does this is ridiculous.