Hacker News Reader

Maybe detecting watermarked text is a skill to be attained. Not allowing proper feedback and training will not allow people to notice the difference on time, thus ruining the data?

Best practice is to allow a number (scaled based on complexity of task) of training rounds (with short feedback loops) prior to letting people loose on the regular samples.

That would be a different experiment.

That's fine. But the author's goal here is to determine if anyone can tell. So he's probably not going to ruin his experiment.

> I believe this is to test the theory that people can detect watermarked text.

> Teaching you how to identify watermarked text while the experiment is running would ruin the data.

But that's complete nonsense. If it's possible to teach someone how to identify watermarked text, then you've already proven that people can detect watermarked text.

Detecting watermarked text is hard. Detecting AI garbage text is easy but then classfiying the garbage further is beyond us.