A mix of site's public api's, rss feeds and webcrawling