Maybe they mean a non-fiction "Learn Javascript in 21 Days" type of book? If not, I really want to read a novel-length (or even novelletee - 80k words or so) book written by an AI to see for myself if the results are comparable to non-self-published authors.
I'm quite certain it is an AI book. My aunt read it and enjoyed it.
I would say this rises to the level of a "coherent" book. Although I would not consider it a "good" book.
[0]: https://www.amazon.com/BOY-SIERRA-MORENA-Rodr%C3%ADguez-Wolv...
The test here was, specifically, coherency, which I feel is going to be difficult for even SOTA models to track over the standard novel length of 100k words (80k for YA novels).
Maybe if it's a novel about a single individual in a limited setting (so, pretty boring, but we are not measuring quality of plot), a SOTA model can keep it coherent?
I dunno how it would do with something like Stephen King's IT or Under the Dome (multiple parallel plots over 450k words, involving multiple main characters, with events on every single page needing to be coherent with the rest of the book), but before we even get there, standard novel lengths (around 100k words) would be the test for coherency.
But a standard coding harness and a good agent that isn't too narrowed in to coding (Gemini or Grok work) with a good skill file and a short prompt can get you a coherent book, with reasonably thought-out story arc, multiple characters, internally consistent world, etc. The pacing will suck, and there will be some misunderstandings about the physical world that read like plot holes.
I would say AI can currently write coherent, but not compelling books. The "good writing" claim isn't really true yet imho. But just like with code you can bring it from 80% there to 95% there with a little hand-holding and guidance along the way.
Not that I think good writing skills are even enough to make AI books compelling over human-written books
Would you consider it a one-shot event, or something you have got to prompt carefully until it gets the 80k wordcount?
But AI can run through those steps on its own if you don't want to give input in between. You have to give it a guideline of what steps it should take, but that's likely just because there is lots of reinforcement learning being done on the steps to produce good code, and basically none on the steps to write a complex story
This sounds like a "continuity supervisor" job in movie industry:
>A script supervisor (also called continuity supervisor or script) is a member of a film crew who oversees the continuity of the motion picture including dialogue and action during a scene. The script supervisor may also be called upon to ensure wardrobe, props, set dressing, hair, and makeup are consistent from scene to scene. The script supervisor keeps detailed notes on each take of the scene being filmed.
Early LLMs were trivially non-coherent. The stories it wrote should shift constantly. The story could start on the moon, then the character could drive to Madison, Wisconsin.
A more obvious way to see this is in video generators. If the "camera" turns 180° twice, we often look at a completely different scene.
Can current models write an entire coherent book? I don't know. I have never wanted to generate such a book. But "do I like this book" is not a good test for coherence.
Challenge: “A stopped clock can’t be reliably used to tell the time.”
Group A: “A stopped clock is incapable of displaying the correct time and anybody that says they’ve seen one do so is a stupid lying liar! I saw a pre-release paper that proved it!”
Group B: “I looked at my stopped clock 5 times yesterday, 12 hours apart confirmed with the atomic clock, and it was within 2 seconds of the correct time every time except once. The people that can’t use stopped clocks to view the correct time are dumb dumbs that are looking at them wrong.”
I've gotten AI to generate an entire book, with the plot points kept coherent (this character knows that when this chapter starts, that kind of thing). It didn't impress my wife, but it was a book.
Not sure how I'd share it. I suppose I could order a copy for you.
Admittedly, I don't think there's any chance it was one shot, rather a pastiche of many, many prompts guided by the quasi-author.