The example e.g. uses Anemone (https://github.com/chriskite/anemone):

https://github.com/zillabyte/domain_crawl/blob/a22e1fe338e28...

Web scraping is just one example of what Zillabyte can do. The open source libraries out there can be a good solution, but our cloud platform lets you scrape the web at scale. That's the main value we can provide in terms of web scraping.

We also support analyzing internal data such as logs. We also provide a pre-scraped web corpus for our users to mine.