Little distributed web scraper project I created a while back if anyone is interested / needs resources : https://github.com/Diastro/Zeek