Hacker News Reader

The reason why people(or ai agents) have not been able to systematically destroy bad research in fields where fraud is so rampant is because they data are not published or easily accessible without emailing the author and asking them.

I sincerely hope that any self respectful journal that publishes papers should have a minimum bar: submit the data on a public link with no paywall or blockers and feature the link prominently on your paper.

View on HN

In this case even emailing the author didn't work. The data was obtained via some roundabout method.

But it's not the real reason IMHO. You could use LLMs to write takedowns like this one. I gave ChatGPT the paper PDF and some neutral prompts. Although it didn't go straight to 'this is clearly fraud' - it's too nice for that - it did compute and point out the absurdly huge effect sizes, and give a relatively low confidence the paper's central claim would replicate.

The real reason there aren't bots systematically destroying papers is because universities defend fraud, they don't punish it. You'd just be burning tokens to reveal lots of fraud with no outcome.

There is a lot of bad ML research for the same reason.

Reply on news.ycombinator.com