Hacker News Reader

If you only care about facts, maybe. Even then I'm sure there are countless facts not described outside of old books.

I have a hard time believing that text valuable to humans would not be valuable to AI.

Agreed, in addition LLMs are trained on a lot of useless data, such as the whole Reddit dataset which has to be at least 90% Reddit garbage, and that doesn’t seem to be a problem. I don’t see why ai labs wouldn’t want to also train on older data

Reply on news.ycombinator.com