>> Is it a mix between apis and direct website scraping?
That's right. I am trying to normalise the data from all the sources so I can generate some useful filters.
That's right. I am trying to normalise the data from all the sources so I can generate some useful filters.
Also is there any legal concerns for website scaping here?
I've made sure not to crawl any sites that do not allow it, such as LinkedIn for example prohibit it, so I left them alone ;)
I wanted to build a service to gather and analyse all types of job information and see trends. I would ultimately sell the data, however I don't think it would be possible reading some API T&C's. Just a flaunting idea.