Hacker News Reader

Comment by opan | Hacker News Reader

The issues I see are that private chats are information blackholes whereas public stuff like SO can show up in a search and help more than just the original asker (can also be easily referenced / shared). Also the fact that these chatbots are wrong / make stuff up a lot.

View on HN

Are you saying that black holes don't share any information? xD

I had never thought about that - I guess the privacy cuts both ways.

That's not really a problem with LLMs, which are trained on material that is, or was, otherwise accessible on the Internet, and they themselves remain accessible.

No, the problem is created and perpetuated by people defaulting to building communities around Discord servers or closed WhatsApp groups. Those are true information black holes.

And yes, privacy and commons are in opposition. There is a balance to be had. IMHO, in the past few years, we've overcorrected way too much in the privacy direction.

Unfortunately though it isn’t actually privacy in most cases. It’s just a walled garden where the visibility is limited to users and some big tech goons who eventually will sell it all.

LLMs are trained on public data though.

Less and less now actually. Synthetic data is now being used on most new models as the public data runs out.

I'm sorry, are you suggesting that AIs are being trained on AI-generated data?

What can possibly go wrong?!?

Only if for as long as public data continues to exist.

Reply on news.ycombinator.com