Offer HN: Web mining/crawling/scraping help

I have experience fetching data from the web, both via scraping and via APIs. If you could use a certain dataset to build or improve your application, I will help you get it.

I will either collect the data you need and send it to you or I will give you the code to collect the data yourself. I will consider helping you with existing code.

I will not:

  * help you spam.

  * help you get unauthorized access to data.

  * write a generic, multi-purpose crawler for you.

Breaking a TOS will be considered on a case by case basis.

You can mention your preferred language, in case I have to give you the code to do the job. You should also mention your preferred format for receiving data. I will most likely use cURL. If there are a lot of responses, I will prioritise interesting/useful/easy requests.

You can find my contact information in my profile.