If you're looking to do any serious search engine scraping, you'll find yourself needing to use proxies.

For my thesis which required millions of datapoints, I used this tool: http://www.scrapebox.com/