Ask HN: Google web corpus + big data analysis cluster?

Thinking about starting a developer friendly service that frequently crawls the web at massive scale + a big data analysis cluster (such as Storm) with support for a variety of languages.

Obviously walled gardens like Facebook and Twitter would be off limits at the beginning, but if the service gains traction, then it's possible companies would want to be crawled.

I was trying to analyze the common crawl recently, and the process of getting set up is non trivial. This service would allow more people to more easily analyze the web.

Would welcome any feedback.