Hacker News Reader

Comment by simonsarris | Hacker News Reader

I could tell this was GPT-3 because it reads like SEO-style sentence structure :/

> I imagine that similar results can be obtained by republishing GPT-3’s outputs to other message boards, blogs, and social media.

I actually wrote a bit about this scenario and how it could explode comment sections to stonewall topics, which I'm calling Commentdämmerung: https://simonsarris.com/commentdammerung

Still, I think a lot of people have been misled with respect to the coherence of GPT-3. It becomes especially clear once you stop looking at highlight reels (aka human curated gpt-3). The cherry picking changes the game of how compelling it seems vs how it really is. The author even does this:

> I generated different results a couple (less than 10) times until I felt the writing style somewhat matched my own

You can't yet claim to have a magic die if you keep rolling it until you get the answer you want!

View on HN

> You can't yet claim to have a magic die if you keep rolling it until you get the answer you want!

The infinite monkey theorem states that a monkey hitting keys at random on a typewriter keyboard for an infinite amount of time will almost surely type any given text, such as the complete works of William Shakespeare.

But here it was just 10 tries, not infinite.

I share these concerns and wonder how much of its opening salvos we've already witnessed on Reddit and elsewhere. One of the tactics I've observed is generating passable quality noise between accounts to push actual important info and links in threads down. The lower they get pushed, and the more low quality the discourse in a comments section appears, the lower likelihood of people getting important information or seeing evidence of something being fake news.

I suspect we'll see this in full effect sooner rather than later with the election upon us on the US.

Can something be trained to detect gpt-3 and things like it?

Every time an article talks about training/finetuning/improving GPT-3, you know it's GPT-3 talking about itself. There's no option to do those things for GPT-3 outside of OpenAI.

More broadly, you can be very sure that a text about GPT-3 originated from GPT-3 if it makes more sense when you replace "GPT-3" by "GPT-2" everywhere. GPT-3 naturally has no knowledge of itself because all related text was written after its training. The closest is GPT-2 (for which there is apparently plenty of corpus to sample from), so that's the content that GPT-3 writes about when forced to talk about itself.

What a beautiful thing is your website. I haven't felt this joy opening a page in ages.

I was thinking the same thing until those animated dots continued to fly around the screen while I was trying to read the words. A strange design choice...

Have you tried cowriting with it? Incredible for first drafts.

What's that process like? How do you use it when writing drafts?

I intentionally didn't participate super actively in this demo, but it should still give you the idea: https://www.youtube.com/watch?v=rZZ_gDjGkzM

Reply on news.ycombinator.com