Scrapy is there to make all these happening under a single framework.