I'm working on a project now which has indexed billions of pages and answers queries similar to a web search engine like Google: https://www.AtSign.co/
The only difference is that it's a keyword + location based business contact information engine but operates on the same principles as a real web search engine client.
We're a small team and it would have been unthinkable even a years back to launch something of this scale effectively ... But here we are! Amazing space to be in right now