Hacker News Reader

Works for me! Cool project!

I really like the "Comparisons" page with brief info about the repos.

Does it crawl all of GitHub to find repos with similar names or only stick to the popular repos that were already indexed? Also how does it rank the alternatives that it finds? For example on https://www.libhunt.com/bitcoin/bitcoin , why is umbrel above dogecoin or bitcoin book?

View on HN

Thanks, mate! It crawls only projects mentioned on Reddit, Hacker News and Dev.to.

Crawling noob here: what's a good strategy to crawl these websites? Reddit is huge, how does one efficiently crawl it? Search API for Github links?

I've built a custom engine to achieve that (Elixir/Phoenix). It uses a simplified version of the Aho–Corasick algorithm https://en.wikipedia.org/wiki/Aho%E2%80%93Corasick_algorithm to match all mentions of subscribed keywords/URLs. I use the same engine for SaaSHub, too.

I see. Nice work!

Cheers! Work appreciation here on HN is highly appreciated. (as that could be a rare beast)

Reply on news.ycombinator.com