This is timely as I’m just building out a crawler in scrapy. Thanks!