ParentFull threadccgreg·The largest index we had was 4 billion, which is tiny. Our crawl frontier was much larger.View on HN