I used scrapy a lot. Just my opinion:

1. Instead of creating a urls global variable, use start_requests function.

2. Don't use beautifulsoup to parse, use CSS or XPATH.

3. If you are going into multiple pages over and over again, use CrawlSpider with Rule.