Hacker News Reader

Not sure if you're serious but a) all HN data is publicly downloadable and used by frontier labs and b) the origin of OpenAI tracks down to former YC CEO sama who was thereafter fired from YC

I don’t know why any company would pay. It can’t be that difficult to scrape this site and they already did it indiscriminately for years, violating laws and taking down public libraries and other public resources with no regard for their impact.

Sure it can be scraped, but it's so much easier if you just get a single database with everything in it. These are companies flush with cash you know.

https://console.cloud.google.com/bigquery?p=bigquery-public-... No idea how to to date it is, but there's two different apis available (official and algolia) if you need to update it.

Are all of the messages public and crawlable?