We have a distributed crawler that volunteers can install as a Firefox extension to crawl the web ;)