'Amateur and dangerous': Historians weigh in on viral AI history videos
bbc.com
bbc.com
As someone technical who works in creative circles, I hear this kind of reasoning all the time and it drives me nuts. The “it’s just art bro, don’t take it so seriously” excuse is so tired, but like the best fake excuses there’s no way to counter it.
Well that's plainly not true. Striving for accuracy is going through the script and doing this thing called "fact checking". It's an actual job that used to mean something to writers, journalists, documentarians...
The noble goal of egalitarian democratization of media has had the unintended consequence of completely blurring the lines between quality and ... non-quality information. What galls me most is the people who care about fact and truth, and used to be the guardians or advocates for such things, are just drowned in a sea of bots, malicious actors, and the ignorant and are thereby discouraged.
No such thing ever existed
However, there’s little point in suing 1 of 10,000 people all spouting nonsense. At least until they gain a little traction and thus enough resources to be worth suing like Alex Jones etc.
There was one good innovation in factuality to come out of the social media revolution, but it has drawn the ire of its owner and looks like it will be put down shortly.
Where we're headed, we won't need facts.
------
It is a melancholy truth that a suppression of the press could not more completely deprive the nation of it’s benefits, than is done by it’s abandoned prostitution to falsehood. Nothing can now be believed which is seen in a newspaper. The real extent of this state of misinformation is known only to those who are in situations to confront facts within their knowledge with the lies of the day.
I really look with commiseration over the great body of my fellow citizens, who, reading newspapers, live & die in the belief that they have known something of what has been passing in the world in their time: whereas the accounts they have read in newspapers are just as true a history of any other period of the world as of the present, except that the real names of the day are affixed to their fables.
General facts may indeed be collected from them, such as that Europe is now at war, that Bonaparte has been a successful warrior, that he has subjected a great portion of Europe to his will etc. But no details can be relied on. I will add that the man who never looks into a newspaper is better informed than he who reads them; inasmuch as he who knows nothing is nearer to truth than he whose mind is filled with falsehoods and errors. He who reads nothing will still learn the great facts, and the details are all false.
Thomas Jefferson - 1807
------
That would have sounded rather hyperbolic about 30 years ago, perhaps even more recently. But now it sounds just about right. I think what many do not realize is that the past ~70-80 years in the developed world, or in other words the complete living memory of just about every person alive today in those regions, was atypical in just about every single way - including some effort towards the pursuit of objective truth. We're not entering some scary unknown place, we're simply returning to the status quo that existed throughout the breadth of human civilization.
This also makes reading the ancient philosophers somewhat literally unbelievably insightful. Plato oft sounds far closer to a proven prophet than a philosopher when you read his writings on, for instance, politics!
[1] - https://founders.archives.gov/documents/Jefferson/99-01-02-5... (highly recommended to read the entire letter - it's equal parts interesting, informative, and entertaining)
https://en.m.wikipedia.org/wiki/Gell-Mann_amnesia_effect >> The Gell-Mann amnesia effect is similar to Erwin Knoll's law of media accuracy, which states: "Everything you read in the newspapers is absolutely true except for the rare story of which you happen to have firsthand knowledge."[3]
That cite says it's from 1982.
So no, the news of 40+ years ago wasn't particularly accurate.
It's not that good isn't enough, it's that it's not good enough.
Its either that or yield to the idea that human psychology is so malleable that global corporations (and the engineers who make millions working for them) control us like marionettes.
By that do you mean stop using it entirely? Because I don't think it's possible for many (maybe most) people to engage without being affected—at least with the currently prominent social media formats.
I don't think social media requires or should be world-scale. I think its hubris to think Facebook etc are meaningfully connecting us to individuals around the world when our social graphs our overwhelmingly local and sequestered.
Finally, because nobody ever asks this question before they build it, there is a potential for regional networks to be more harmful - for example in a region with active genocide you could see regional networks aggravate that harm more then the US tech companies do.
It's a tough nut to crack but I don't think it compares to the hardest challenges humanity has already conquered.
Agreed. I'm not sure that the fix is necessarily to regionalize though. I think rather that the weakness is in the format, mechanics, algorithms, etc. We need to re-imagine social media in general (yes, I know this might sound hand-wavy). The true fix might be so different that we don't even call it social media, and...
>there is a potential for regional networks to be more harmful
Exactly. That's why I believe we need a more fundamental change. All of the current formats have the capacity to wreak havoc, whether globally or locally.
>I think its hubris to think Facebook etc are meaningfully connecting us to individuals around the world
Yeah, I don't know that Facebook was ever meaningfully trying in this regard, except to promote some tag line, "something-something connecting the world" to make it seem they were on some noble quest. All they really wanted was eyeballs, and judging from the sheer stream of garbage that is today's FB feed, they're not even pretending anymore.
But it is that malleable, who would even dispute that?
But the way these discussions always seem to go, is that anyone who provides counterexamples is immediately told they're imagining things and/or gets insulted for being unable to see what's really going on.
There’s nothing wrong with it as long as they’re not presenting it as history but are presenting it as the work of fiction it is.
Unfortunately they’ll, at best, have fine print that says it’s not history but the whole presentation is supposed to encourage the viewers to believe this ks real.
too many dummies read a line like not 100% accurate and assume the content must be something like 90% accurate.
Whether it's for political gain or profit or otherwise, the value of truth and shared reality has been greatly diminished. It's not just that the videos aren't accurate and the creators are so dismissive. It's not even as much about the supply side any more.
It's that half or more of the population is so willing to choose their own reality and could care less whether it's actually true.
I think we can safely call a spade a spade here: people making lazy AI historical videos are just that; lazy. They found a cheap and easy way to churn out content that makes money, and their greed outweighs their commitment to truth or historicity.
Pompei and the Black Death aren't historical events that continue to evoke grievances today.
But creating an AI generated recreation of the Nakba or Nanjing Massacre can evoke extreme reactions to this day, and actually instigate diplomatic fallout and even violence in the modern world.
If you keep percolating and percolating such content, then it can complete shift narratives.
Technology is inherently neutral - it's us humans who use technology for good and for bad - but moderation has simply not kept up the rate of change.
> it's more concerning that TikTok's algorithms are able to get people to give their attention to such poor quality content
People will continue watching what they want, and recommender algorithms will continue to recommend them as such.
If recommender algorithms are not regulated, then this is the status quo that arises.
On that front, statist countries like Singapore have better managed these problems, but they also pair it with permissive national security legislation.
especially when it comes to media, Postman would pretty strongly disagree here. https://www.goodreads.com/book/show/74034
Edit: still is.
If you have to ask... The answer should be clear.
It is a good signal not to watch whatever this is.
I do believe bulk of the use for this more than for education purposes, will be for propaganda, radicalisation etc.
While the makers might get away making 'its just art' excuse. This will be a new round of fake news/history flood unseen like ever before. Every bit of vague/abstract statement, or even an absent detail in history books can be taken out of context, or just made from fiction to create narratives against vulnerable groups of people.
One wonders how this will be regulated or if it can even be regulated.
When people talk of AI safety, more than terminator/skynet style apocalypse I largely imagine these sort of things to cause more short/middle term damage.
The solution to this being used to disseminate falsehoods is education, both about the technology (to make it easier for the average person to spot AI content which at least for the time being is still possible) and about topics likely to have falsehoods spread about them.
You cannot put this genie back in its bottle.
If not, then I believe anything that present history is education, be it on YouTube or in a classroom.
I believe this not because of some preconception or ideology, but because I observed that non classroom material is often referenced by people looking for historical justifications.
Current events would suggest that the word "third" is redundant.
Well, at least the couple people interviewed for the article who don't want casuals intruding into their newly democratized profession.
Also why is it suddenly a good thing that people who know nothing can talk shit about it? Is the bar lowered so much already that “can type words in an LLM” is sufficient?
- houses wouldn't have had large glazed windows
- there were no trains (a train track is visible)
- Vesuvius didn't start with lava spewing everywhere
- stemmed wine glasses and pepper mills didn't exist
- people would be reclining while eating, not sitting on dining chairs
- the bread roll is a modern loaf, not an ancient one
If you're going to nipick to this degree of anality then essentially any historical documentary ever made is "amateur and dangerous."
It's contextual. Horrible Histories can make boners. some soft-ed deliverable can make boners about things, not core to the syllabus. If you call it "history" and you want to teach lived experience, then don't put tomato on the roman pizza. It's actually not that hard to get right btw. Mostly, its lazy.
It did things such as rather dramatically change the widely recorded historical personality/interests/etc of Claudius, presumably to make him a more likeable 'protagonist'. And they weren't pilloried for it whatsoever but rather drowned, in praise and awards.
Much of the history about roman times is under reconsideration in the light of things like new digs in Pompeii. People projected current social values onto what they found, DNA analysis now permits much stronger indications of filiality or patriality of the remains. "oh, this is a mother protecting her child" can turn out to be a male, and an un-related child female. How this is re-interpreted is not always clear.
Likewise metallurgy can change our view of history. The huntarian museum in Glasgow University has 4 coins, held by past antiquarians and historians to be crude forgeries. They turn out from metallurgy to be real, and futhermore confirm an emperor held for a very long time to be speculative, and undocumented. We now have structural evidence of his existence.
AI tiktoks aren't currently helping here. They aren't providing visuals which carry the history forward, they just project classicly bad tropes. Sure, they're entertaining. So is "gladiator" but historians had enough on their plate there.
That's why all of this and then to complain about a short clip having a few mostly irrelevant mistakes (which is not to say the author should not endeavor to correct them) is so utterly transparent as gatekeeping, let alone with such utterly hyperbolic phrasing as calling it "dangerous."
The danger here, is autodidacts, who take this tiktok as a source of ground truth in their ideation of how the past is. We can see the effect in Vikings-have-horns story. Thats an almost entirely modern construction. It literally has no historic context, horns on helms appear in times, for decorative purposes. We knew from archeology viking helms didn't do this but Hollywood does as hollywood must. Kirk Douglas looked sexy as a viking in a helm with horns and here we are.
Yes, "dangerous" is hyperbole. Everyone arguing a case uses hyperbole, rhetoric was a significant component of the cursus honarum for romans with status to enter the senate. your enemy was full of shit, literally, or more figuratively, because that was how you won. The danger is not the same as the danger of eating poisonous mushrooms, or walking in bare feet on broken glass. its rhetorical danger.
Gatekeeping exists. Objections to it, tend to look very like another rhetorical objection. IF you were permitted into the gatekeeping camp, you'd do it to, and in fact, what you are doing can be said to be a function of using the gate to hold it open to every theory allowed, rather than using the gate to shut off noise. you're therefore gatekeeping too, in a different sense. keeping it open, to suit your own purposes.
The latter is far less relevant than the former, yet it's the former pretending to freak out about the 'dangers' posed by the latter. And no I don't gatekeep on anything, ever. It's childish, insecure, and myopic. The more people that get involved in any thing the better that thing will be, in the longrun.
Awesome to video, and constructed reality. Not so awesome to fine detail. It will be similar for "what would it be like to be inside a nuclear reactor" because it is very unlikely to model the real cherenkov radiation effects, or the decay of the video CCD and your eyeballs, unless suitably prompted and even then, its so subjective, the most likely outcome is the video tropes in millions (hyperbole) that can be scavanged for imagery. Or surgery, which will model what TV doctors do which tries to be faithful, but can only approximate. All the AI models of the world will be nit-picked to death, and subsequently improve.
The critique is of course input.
And yeah, the nitpicking can indeed lead to much better outputs in the future. And also give historians a chance to flex their knowledge of esoterica. And unlike some high production value historical series, it can all be redone with this new input in no time. Of course with new mistakes to then correct, probably endlessly, but there's an asymptote towards perfection we can progress along. When the authors start intentionally breaking things to inject their own politics or biases though, and then presenting that as 'authentic', I'd be the first to be here bitching about it. Well unless the author had some reasonable, if fringe, argument for that being what things were "really" like - history is, in many cases, a recreation based on best guesses, and those guesses end up wrong with a reasonable degree of frequency.
I would understand (and not agree) if you said you don't think the videos are dangerous or problematic, but dismissing valid concerns from subject matter experts is just pure tech hybris. And that's quite scary, to be honest, to see how many people already subscribe to this complete lack of critical discussion on the AI video trend.
These videos are viral traps made to make money. They have absolutely no historic base, and yet they are presented as such on social media. I don't care what the authors say, because that's not what 53 million people read when they just see a video that's absolutely inaccurate.
https://www.youtube.com/watch?v=W86cTIoMv2U
Not to mention Planet Earth, which feels like watching Finding Nemo
Edit to add: I’m sure the majority of devs on this site have opinions on current LLMs, is it fair to dismiss everyone’s concerns and tell them “you know how to program, make a better model.”
That feels wrong.
So creating accurate generative media is categorically more difficult than inaccurate media.
Also there are videos made by historians or science educators.
Of the top of my head I can think of Flint Dibble who is an paleontologist? and miniminuteman who is a science communicator who also has an archeology degree?
And while both of them have decent to great success on YouTube, their success pales in comparison to the Ancient Aliens and Atlantis video makers, simply because those are more attractive stories even if they’re not real, but are presented as legitimate theories.
We are rebounding from a historically brief period of high trust to something more historically normal.
The difference between campfire stories and the world we live in is our world has journalists who fact check and surface falsehoods. Sure, there’s a delay. The work takes a moment. So we hang out while experts do the debunking for us.
That’s a pretty good state of affairs.