Crawling Billions of Pages: Building Large Scale Crawling Cluster (part 2) | Hacker News Reader