ChatGPT quality strangely gotten worse

At this point, someone should be periodically testing ChatGPT by scoring it against a set of questions (constant, not public, of varying difficulty, and enough that the score is consistent if you run the multiple times on the same day). If ChatGPT's score declines, there's clear evidence that OpenAI made it worse.

Otherwise, I really doubt any of these reports. "ChatGPT got worse" is so common that, if it was true, there'd be solid emperical evidence (there's the Stanford study, https://arxiv.org/pdf/2307.09009, which shows ChatGPT can degrade across releases, and I believe that; but these claims are about it degrading in the same release).

Thanks for the link. Agree this is super subjective and as much about the user as the machine as the users brain also evolves over time... Would indeed be cool to have comprehensive testing.

Switched to Claude a few days ago because I was noticing the same thing

They are probably using compute for something better i guess >On a Tangent,Is anyone cringed out by the tweets meta (cryptic tweets by openai or marketing stunts)