Hacker News Reader

Comment by blhack | Hacker News Reader

You could call it: "AI Kessler syndrome".

The internet becomes so full of hallucinating AI output that it becomes impossible to train the model.

Worse, perhaps. Kessler Syndrome will eventually resolve itself as junk falls out of orbit over time, or new methods for cleaning it up are developed. Information, once buried in noise, becomes unrecoverable without a source of known truth for correlation.

Curation is the answer. The more junk, the better off are the one curation for quality, relevancy and human interest.

Curation that tracks the provenance. If we receive a string of text by itself we can't do much about it. We need to know from where it came from, whether it was written by a human, etc

Human provenance is less important than human curation here. AI can already infrequently output content that surpasses average human-generated quality in certain categories. As long as in the end you are checking that content exceeds an average bar of quality as assessed by human aesthetics, and ensuring that you have a diverse set of content (eg. not overrepresented by content that AI is particularly good or prolific at), it should still improve outcomes.

I still want to know if the content was written by an AI, because text quality (whatever that means) isn't the only metric humans care about.

This is a brilliant analogy

So the first one takes it all?

No more that as you get more AIs, all AIs get shittier together.

Or, the singularity.

That would be something else, like if someone built a Chat GPT that could train itself and it starts learning at an exponential rate, and learning how to make itself unstoppable by humans.

No AI will survive a solar flare! So we just need to hunker down in Zion and wait for that.

the singularity implies reaching a point where the AI’s improvement becomes self sustaining. this is the AI choking itself to death with bad training data.

I'm going to suggest giving Accelerando a read and consider the late state of the singularity.

http://www.accelerando.org

(heh - checking that link Charlie Stross just posted (Jan 31) a blog post: "An AI app walks into a writers room")

Anyways the link I was actually after ... give https://www.antipope.org/charlie/blog-static/fiction/acceler... a read and consider the "what happens in the later parts of the book."

Reply on news.ycombinator.com