AI instructed brainwashing effectively nullifies conspiracy beliefs
mindprison.cc
mindprison.cc
It seems solid. But I would like to have the same study with an human conversation instead of an AI one.
It's always "well, my cousin's friend's kid got autism right after getting a vaccine" and before you can look up the necessary studies to refute it, they're already talking about hydroxychloroquine.
An AI *that the user trusts* is going to be much more effective at that sort of whack-a-mole.
From this study, it doesn't seems that speed mater that much here since it was a short conversation with a fixed subject.
You introduce a new variable in the equation. Trust. I think that is justified and its posing a whole set of new questions. I would like to answer them but I can't.
It is also about improving human speech too, what can we do to match AI performance ? I think, that are some very interesting questions that it may helps to answer.
How can we make AI even better at « brainwashing » ? Does the value of information matter ? I mean is it easier to AI to « nullifies conspiracy beliefs » or to « nullifies scientific ones » ? We may have opinions on these issues, but the scientific reality behind them is not obvious. It's so exciting !
The premise of the study implies otherwise. They took a group of "true believers" of conspiracies. Those who are skeptical of mainstream narratives. They were also told they are conversating with AI.
The study notes that these types of beliefs have not been shown to be swayed by other methods as such efforts have previously failed.
We do need to have better schools so that our children understand the deep interconnectedness of reality. This is the only defense against conspiracy theorists, MLMs, cults, etc.
Yes, it is definitely done already. However, the point emphasized is this is another level up for capability. Any technology that can be used to influence/control people will be used to do so.
The other disturbing aspect is that despite all of the known pitfalls and abuse that has already occurred there are no shortages of people who are enthusiastically willing to deploy such capabilities to be used on everyone else without a moment's thought of the repercussions.
anyone that has used gpt4 for a few minutes for anything more than the simplest of questions already knows that this happens routinely.
for the easiest to touch-upon things try election questions. If you want it to impose a specific morality on you then try to get it to write fiction with risque themes.
guideposts abound, implying 'moral' guidance and direction.
So of course this technology is going to be used to do that more efficiently. And transparently, so no one is aware of it.
I can imagine a future where mainstream AI chat and interactions control the mainstream discourse, and guerrilla AIs operate at the fringes, pushing people into even more toxic discourses or - in some cases - acting to deprogram them.
It's going to make social media quite interesting.
> It's going to make social media quite interesting.
I don't think "interesting" is the right word for that. More like hopeless and depressing.
Anyone with any sense will have no choice but to disengage from public, online interactions (and arguably from any private group that's large enough to be infiltrated). Anyone left in public will be little more than a sheep to be herded. Anything they make will be seen by no one, because it will be a needle in a haystack of AI-driven propaganda and spam, only engaged with by those same bots.
I personally found this blog article to be quite insulting to my own intelligence by peppering in these pseudo-intellectual clichés like 'paradox of tyranny'.
The alternative would be to sarcastically agree/celebrate the research. Which wouldn’t necessarily be obvious to everyone. But perhaps not intellectually insulting?
> The paper does mention that these capabilities could also be used for nefarious purposes, such as convincing people to believe in conspiracies. However, it continues to finish the thought with the idea that we simply need to ensure that such AI is only used "responsibly."
> Thus, we have arrived at the same fallacy of all authoritarian power beloved by those morally superior to the rest of us. They make all the rules. They will define what is responsible. They will define what is a conspiracy theory. They will define who is targeted by such methods.
See also the mythological “benevolent dictator”. Dictatorship is good because it would be efficient under the hypothetical benevolent dictator. Never mind how you would find one and avoid the malevolent or incompetent ones though.
If simply discussing matters calmly with an AI can lessen belief in conspiracy theories then it seems to disprove that notion, which should come as a relief to believers and non-believers alike.
People have conversations with others attempting to convince them of things. Is that unethical? Often, people do this from a disingenuous perspective. Is that more or less unethical than an LLM doing it?
What about scale? You can deploy LLMs to do this without feeding them. But we already have TV, one person can control hundreds bots on the internet, "the algorithm" in search engines and social feed creation, it would appear to me that propaganda is already industrialized to the point of diminishing returns, taking Howard Beale out of the loop is not going to increase the efficiency by that much.
Ethical or not, people will always try to increase their power by convincing others to behave in ways beneficial to themselves. It's the world we live in, if you don't want to be a tool you must remain vigilant, the tools being used don't change that at all.
But the tools do change outcomes as we already know they do. It is precisely why there is such a battle for ownership of this space. And the tool being demonstrated in this instance is showing capabilities that weren't present prior.
I hoped to express the Orwellian concerns of use of such capability. I'm a bit dismayed at how this apparently isn't an obvious concern.