Hacker News Reader

Comment by omnimus | Hacker News Reader

Today? In images? Quite easy. In text? Pretty hard. And if you do some cheking and editing then pretty impossible?

In two years? Look where the space was two years ago. I think many things will have to change.

An amusing part with all of the AI-generated graphics is that it's pretty bad at producing the right amount of fingers, among other details. This one really jumps out. I'm assuming that will be ironed out eventually but the devil, as always, remains in the details.

GPT-3 definitely has a writing style. I assume it would be detectable, ironically, by an AI.

if it's detectable by an AI, you can GAN it into erasing its detectable writing style.

I think you could make the GPT's more undetectable by a computer using GAN techniques but that might well make the thing more detectable by a person. The GPT-style is something like rhetorical devices run together to make various claims unfold smoothly. An alternative approach could make the things inconsistency more obvious to a person.

GPT-3 definitely has a writing style that can be detected by AI. But here's the thing: it's really easy to change its writing style. All you have to do is give it different input data and boom, you've got a whole new writing style.

That's not easy, it costs millions of dollars to obtain large amounts of clean data and retrain those models.

No, it would take approximately 3 minutes where you either write a paragraph in the desired style yourself or paste one from the Internet and then ask it to continue in that style. Even if you decided to go the more onerous fine-tuning route, it would require 1-2mb of text, cost very little, and you'd be done in a few hours. It's easy.

Well, that may be true, but even with a small amount of data, you can still change GPT-3's writing style to some extent. And you don't have to retrain the whole model from scratch, you can just fine-tune its existing settings to change its writing style.

But you don't really have to retrain the whole model to modify it's writing style, fine tuning would probably be enough

Reply on news.ycombinator.com