Comment by ytkimirti | Hacker News Reader

Comment by ytkimirti | Hacker News Reader

Hello HN,

This was a small project of mine after I've found out that I can simply the whole hackernews archive (~48GB) and play around with it.

You can compare terms just like in google trends and you can also see the exact posts & comments from that time.

I like that you can discover what went crazy in the timeline, they just come up as small burst of activity, it's quite fun to play around with it. https://hackernewstrends.com/?q=litecoin&q=dogecoin&q=solana...

I also have a seperate page for the "Who is Hiring?" posts, here is the distribution of programming languages over each monthly "Who is hiring?" post in HN ever. https://hackernewstrends.com/who-is-hiring

Any kind of feedback is welcome.

> https://hackernewstrends.com/who-is-hiring

Currently it says "no job-post mentions in this window" for everything. Transient error?

This is excellent.

A minor suggestion - I'd like to be able to render the current graph taller (full height of my browser window).

Also some sentiment analysis on the "people" graphs would be very insightful (particularly for the likes of Edward Snowdon, Julian Assange, Elon Musk and Sam Altman). Perhaps colour the area under the graph red-orange-green based on the sentiment?

Thanks for the feedback, noted the full-screen request.

The sentiment analysis is very interesting, I can do that easily. Could be a new page as well. Did you see this anywhere else or just your idea?

Just my idea. I'm working on a side project https://newsavista.com/invite/ASAD68923E that aggregates news and tracks news trends and changing sentiment on the major stories. With cheap cloud LLMs (and "free" local LLMs) it turns out to be a trivial feature to build.

Honestly the HN archive is very valuable. If you had it all on a local db with everything indexed you basically end up with a offline search engine.

Where is this archive located you speak of?

It's on firebase, per https://github.com/hackernews/api

found : https://huggingface.co/datasets/open-index/hacker-news

Reply on news.ycombinator.com