Hacker News Reader

Comment by WheelsAtLarge | Hacker News Reader

Are there really apps than can distinguish AI vs human? I suspect that at best they can only id a small fraction of what is being written.

View on HN

There are ones that purport to, but none actually do. The false positive rate is crazy high.

If that's the case then they have little use. We'll be reading AI created text from now on and we won't even know it. I'm not sure how I feel about that.

This does a very good job with everything from GPT afaik, better than the official one: https://openai-openai-detector--f4d78.hf.space

But as we have more non-GPT LLMs, we'll probably need more detectors.

It's pretty awful actually....

I sent a one liner prompt to Chat GPT(3.5) to generate an article about some technical topic, sent it to this detector it said 99.98% real...

there is no way to detect decent LLMs at the moment

Zerogpt works fairly well!

nope, it's crap

I got "Your Text contains mixed signals, with some parts generated by AI/GPT" for a Wikipedia article

and "Your Text is Likely Human written, may include parts generated by AI/GPT" for a GPT Generated article

there is ZERO ways to detect gpt

I wonder what % of wikipedia articles do have substantial portions of AI-generated text by now (and is it really a problem, providing the information is accurate - in fact in most cases I can't even imagine caring too much either way if something's written by a bot, but I do care if it's hallucinated BS).

it's an old article it's not ai generated

Reply on news.ycombinator.com