Scraping is only one part. How are you going to categorize, store and search the data !?
Saving everything in a way for use it later is much harder (and expensive), IMHO.
If you have a good data model the categorizing, storing and searching of the final result the isn't a big problem and the scraping is the complicated part. If you don't have a specific kind of resource you are scraping and just dump everything into some storage solution with no structure that's going to be the hard part while scraping is the easy part.
Anyway Im a noob, but reading here and there is what I decided to use.
For scraping Im using scrapy + selenium and a modified js script that uses chrome (webscraper.io).