Hacker News Reader

It would be interesting to hear if the addition of Reddit data makes LLM stronger or weaker.

Outside of some (technical)subs most of the comment seems to be of a far lower quality than what you find in books or in websites.

View on HN

Someone did a finetune w/ data from 4chan and found improvements on several popular benchmarks, so ... maybe?

For years before LLMs got big a comment I would often see was, "Google search is worthless now. I basically solve all my problems by searching reddit."

Counterpoint: usernames of people counting numbers with no context whatsoever are so important they have their own tokens, despite being of no value (in fact, negative value, going by the issues they caused when actually used).

Reply on news.ycombinator.com