Hacker News Reader

Comment by MisterMunchkin | Hacker News Reader

They've corrupted their data set by padding it with generated slop, in the misguided belief that you need 10PB of data to train a brain. Every training round they load more AI slop into it, further amplifying the slop language.

It's fascinating, Sonnet 4 is still available via API and it's so much less moronic than the current model. All of the em-dashes and nonsense are a result of the repeated rounds of reinforcement learning using slop data.

View on HN

But why did that style of writing get rewarded? The people at Anthropic are ultimately responsible for the reward signal and what it produced.

I blame it on their focus on "persona design". They botched it.

"They botched it." <-- sure, but worse.... they shipped it anyway. And that is the part that gets me. It's a vastly worse product than it was on like 4.6. I suppose you can (and should) use opus 4.6 -- they do make it available still. Then just treat 5 as something you avoid until they push out a new version.

i think they took a bet that TED talk style chat would make their AI offering feel like the better offering. they didn't anticipate that it would become a meme. because of course they didn't, what a stupid idea to train around and reward in the training. you gotta be smoking real delusion to think that was going to be a game changing feature. at work we even got non-technical people making fun of it like crazy now.

going back to opus 4.8 and on is literally like talking to the guy who wants to hear his own voice in meetings. going back to 4.6 is actually refreshing, and it feels so much faster. actually gonna laugh if 4.8 and on is so slow because it's draining lakes fighting for its life trying to conjure up this god forsaken persona.

Reply on news.ycombinator.com