This is awesome. I've been looking for a way to scrape Who's Hiring for my site https://200kjobs.com, thanks for sharing.
First search for the "Who is hiring post?": https://hn.algolia.com/api/v1/search_by_date?query=hiring&re...
Note the ID of the first (latest) post and then get the comments: https://hn.algolia.com/api/v1/items/39562986
hnhiring.com looks super cool, I'm curious if you have any stats or infographics about the data
have you played with the data and LLMs to try to get some insights?
I only use regexes to extract info. Haven't tried LLMs but that could be useful
Might try scraping it too ;)
Btw, random observation that surprised me when scraping Ask HN, most jobs (100+) are posted the first day of the month, but there are about 15-25 additional jobs posted everyday. This means it’s worth it as a user to get those extra daily listings, but it’s a pain to search through them
Feel free to scrape 200kjobs: https://200kjobs.com/feed
As an aggregator it’s true that finding salary ranges is quite the challenge
As an applicant, I’ve settled for just only applying to the positions that have a range
If Im really curious about a company without ranges in their listings, GPT/Google sometimes give decent estimates
But also, after seeing 100+ listings, I’ve noticed that for the positions I’m looking for, there’s a pretty standard range, which doesn’t vary too much, unless it’s a FAANG or super hot company
In any case, using Command Jobs I only get 5-20 job matches, which are also pretty easy to check manually, and it’s not too annoying, given that usually the matches are very interesting and also it’s not 100s of jobs to r