http://codeascraft.com/2010/07/09/batch-processing-millions-... is a writeup of a similar task at Etsy to resize 135 million images.