What do you mean by “provided”, exactly? Just because something can be accessed via HTTP GET request doesn’t mean it’s legal to fetch it, and does not give you an implicit license to do with it whatever you want. Google, in fact, will happily, scrape, index, and serve queries from PDFs of illegally pirated copyrighted books.

You might want to check again: https://en.wikipedia.org/wiki/Authors_Guild,_Inc._v._Google,....

> For works still under copyright, Google scanned and entered the whole work into their searchable database, but only provided "snippet views" of the scanned pages in search results to users.

The same way we can't process what a trillion dollars looks like, we can't actually process what large scale theft looks like. For shits and giggles, these people also have a trillion dollars.