Hacker News Reader

You wouldn't even need to mine it - https://github.com/HackerNews/API

Sorry, I meant analyze. I actually am writing a blog post right now on this (this thread was very inspiring). Should be up in a day or two at https://applecrazy.github.io/blog

Good luck downloading 16 million records...

You could do that with the Algolia API: https://github.com/minimaxir/get-all-hacker-news-submissions...

But as noted, BigQuery is more pragmatic.

Why? 16 million isn’t much, maybe 10 to 20 gigabyte if compressed.

I’ve seen IRC bouncers that have more messages stored for a single user (270 million, in fact).

I have a script running on aws right now.

Even easier: All Hacker News posts are ready to be analyzed in BigQuery.

- https://medium.com/@hoffa/hacker-news-on-bigquery-now-with-d...

https://news.ycombinator.com/item?id=2120887 my estimate was 200% a long time ago

20 upvotes got me on the front page one time. It was the most views I've ever had on my blog. It got me a job interview! Nothing came of it, but still a wild ride.

I was once on the front page too, but sadly, no HS internship or job of any kind came out of it :(