HN
Hacker News
Top
New
Best
Ask
Show
Jobs
Comment by joshpen188 | Hacker News Reader
Full thread
joshpen188
·
Why didn't you use common crawl instead?
View on HN
dor_jack_2
·
For our purposes Common Crawl's corpus was missing too many websites (possibly due to robots.txt configs of websites) Also we needed some deep coverage which CC could not provide.
Reply on news.ycombinator.com