Hacker News Reader

Comment by xando | Hacker News Reader

I’m not too sure if the question is meaningful. But since I’m running https://whoishiring.io and scrapping all major sources with jobs for developers, I have a lot of data related. I can put some numbers here.

Top 10 from all sources (that I'm looking at) since August 2015.

  Javascript 27.69%
  SQL 22.41%
  Ruby 17.71%
  Python 17.60%
  AWS 13.85%
  Ruby On Rails 13.83%
  AngularJS 11.47%
  Java 10.89%
  PHP 10.57%
  React 10.46%

(top 100 https://gist.githubusercontent.com/xando/1853d5e48f94abe2f13...)

Top 10 from “Hacker News Who is Hiring” since 2011

  Javascript 24.17%
  Python 22.38%
  SQL 18.63%
  Ruby 18.13%
  Ruby On Rails 17.00%
  AWS 12.38%
  AngularJS 10.82%
  Java 10.13%
  PostgreSQL 9.72%
  React 9.53%

(top 100 https://gist.githubusercontent.com/xando/d1daca52b797e725175...)

edit: where 100% equals all jobs tagged as remote.

View on HN

To add to this, here are some charts that I put together for https://cleanwebjobs.com.

Tech skills desired by employers: https://twitter.com/CleanwebJobs/status/767684601615704064

Tech skills available in the marketplace: https://twitter.com/CleanwebJobs/status/767683809714245632

Python and JavaScript are the biggest players along with UX/UI design (not really development). Seems to match the data above.

Unfortunately we don't track remote work independently, but I may be able to trawl through the location data to extract this information.

BTW I have a recent Show HN on this if you have other comments that would take this thread too far off-topic: https://news.ycombinator.com/item?id=12759415

5% of people have design skills, yet 17% of employers seek designers. Interesting.. Maybe I should turn to design, instead of front-end development.

It would be useful to compare the proportions difference between non-remote and remote instead of the absolute popularity.

Example: Since SQL dominates most job offers already, it's gonna dominate also remote jobs offers. What you want is to look at technologies that are more predominant in remote than non-remote.

Actually a lot of people ask me about different angles for the data. For this reason I'm trying to build a stats / trends page. So feedback / requirements welcome.

I think it would be better to just let people download the raw data (like the database dump). Then people can do their analysis on top (like, I could produce the stats I just told you about)

Actually what would be cool would be to release the data, and hold a contest related to it. Maybe one award track for interesting analysis, one for presentation of data. You could probably get some companies to sponsor it, as it's cheap advertising that people will be interested in viewing. Plus someone might be able to write up a paper on it for journal publication.

This is the first question that came to me.

Although, if people want to be hired for remote work then the absolute percent matters more, but if there is some reason to believe that remote work is different, this would illuminate that difference.

This is really cool. Do you have a breakdown by year? Comparing Angular to React since 2011 doesn't seem really fair.

Thanks. Check this blog post that I wrote https://blog.whoishiring.io/hacker-news-who-is-hiring-thread...

Not really representative. JavaScript is used in almost every web app (like HTML) but pure JS (i.e Node) jobs are rare compared to PHP, which isn't even on the second list. Likewise with SQL: every web app uses a database.

Unrelated to the OP, but what are you using to resolve place names to geography?

Seems to be mostly on target, but you get weird stuff like Camden Town (UK) -> Camden, New Jersey, US and it's common enough to notice.

http://nlp.stanford.edu/software/classifier.shtml I'm not too happy about it.

But, I planning to replace it with simple knuth morris pratt text search against the list of all significant locations. This 100x slower but results are rarely bad.

Cool, thanks for taking the time to answer.

Just wondering what you used in the back end for the database and storage?

Python, Elasticsearch, Postgres

Unrelated to OP, the instances where you're scraping HN 'who's hiring' threads seem to be missing the job title lines.

Would you be able to take the first line of the posts as job title? Thanks

I guess you mean "scraping", not "scrapping"

Reply on news.ycombinator.com