Hacker News Reader

Sounds like blekko had a larger impact on the early urls than I thought. Out of curiosity, do you remember how large blekko’s index was at it’s peak?

The largest index we had was 4 billion, which is tiny. Our crawl frontier was much larger.