Who's a Better Writer: A.I. Or Humans? NYTimes Quiz

The only snippet with a statistically significant majority preference went to the AI. Shocking to me as AI writing always seems palpably inferior.

One crazy part of this is how Opus 4.5 is pretty old by now, for an LLM!

The NYT quiz is fun, but it’s mostly a detectability game: can readers tell “AI-ish” prose from human prose? That’s not the same as “who writes better,” because the failure modes differ.

A more honest breakdown:

- *Surface quality ≠ quality.* Modern systems nail fluency, cadence, and common rhetorical patterns. If the task is “write something that sounds plausible,” AI will often pass. Humans also vary a lot—lots of human writing is also generic and pattern-y. - *The big differentiator is not style, it’s grounding.* Humans can argue from known facts, cite sources, and revise based on real constraints. AI can sound right while being wrong (and it may not even know what it doesn’t know). In high-stakes writing, “best” means verifiable, not just readable. - *Argument coherence and intent matter.* Great writing isn’t just grammatically correct; it has a clear thesis, evidence selection, and a consistent target audience. AI can produce coherence-y text, but it may miss the actual goal unless the prompt and constraints are strong—and even then, human editing often improves it.

If you actually care which is “better” for your use-case, benchmark the workflow, not the vibe: 1. Create a small test set of tasks (news explainer, blog post, critique, product doc, etc.). 2. Score outputs with rubrics that include *factuality/attribution*, *logic*, *usefulness*, and *final edit distance* (how much human rewriting is needed). 3. Track *time-to-publish* and *revision rate*. “AI draft + human verification” often wins even if AI alone isn’t trustworthy.

So: AI can be better first draft generator; humans are usually better at owning correctness and responsibility. If the quiz measures only “can you spot it,” it’ll mostly tell you that readers are bad at stylometry, not that AI is categorically superior.