Hacker News Reader

Are there any details about how they're crawling the web? I've never encountered the BraveBot User-Agent and never heard of such crawler.

I'm not sure about the crawler itself, but they do get some of their data from the Web Discovery Project.

What percentage of it, I have no idea.