This, IMO, is the actual biggest problem with LLMs training on whatever the biggest text corpus us that's available: they don't account for the fact that not all text is equally worthy of next-token-predicting. This problem is completely solvable, almost trivially so, but I haven't seen anyone publicly describe a (scaled, in production) solution yet.
Can you explain your solution?
It's probably the AI thing I'm most excited about, and I suspect we're not far from that, although I'm betting the copyright battles are the primary obstacle to such a future at this point.
People from Europe, came to have the Industrial Revolution at just the correct moment.
Some small changes in history and it would have happened in India.
It is making a theory to fit the facts.
I do not think the author is a "white supremacist" but the book reads like that. Taking all the accidents of history and making them seem like destiny that Europeans rule the world (they do not, they never did, and they are fading from world domination fast)
Thinking Fast & Slow was a fun read, but I did not retain much more than the basic System I/II concept which I find is a useful device.
It's not just that individual studies have failed to replicate. The whole field was in question at least a decade before the book was written, and since then many of the foundational results have failed to replicate. The book was in a sense the last hurrah of a theory that was on its way out, and the replication crisis administered the coup de grace IMO.
I want something similar but for children's literature. From Ralph and the Motorcycle to Peter Pan, a lot of stuff doesn't hold up.
The books provide plenty of utility. But many things don't hold up to modern thinking. LLMs provide the opportunity to embrace classic content while throwing off the need to improvise as one parses outmoded ideas.
You could not redact piece of art out of "old ideas". It is like re-drawing classics paintings but mask nipples and removing blood.
And books which could be redacted this way without falling apart — well, don't read such books at all and don't feed them to the children.
Literature for children must not be dumbed down, but exactly as for adults, but better.
Also please omit "who has a better story than bran"