Hacker News Reader

What sites are you searching? I built a web scraper to help automate my job search in NOLA

http://nolatechjobs.leesome.com/

I'd be happy to share the code with you and you could switch out the sites I'm scraping with the ones you look at. The whole thing runs on a cronjob that just re-generates the HTML every hour.

View on HN

Right now when I look I usually use Indeed and StackOverflow. I gave up on the big boys (Monster, CareerBuilder, Dice) because the sites are so polluted by recruiters and the filtering tools are so poor.

I'd love to try your scraper. I've thought about doing something like that before, particularly since I have started doing lots of web scraping for work and I am much more comfortable with it. Do you have any issues with sites that actively or passively discourage scrapers?

Nope, haven't run into any issues. I scrape Craigslist from RSS and the others from the HTML. I only hit the sites once an hour, and leave a unique browser string so they can filter me out of their analytics.

My e-mail is in my profile and I'll be happy to send over the code.

Reply on news.ycombinator.com