> Because Common Crawl stores only the first 1 MB of each PDF
That limit became 5 MB in March 2025.
Reply on news.ycombinator.com