The Agency: An army of well-paid “trolls” in St. Petersburg
nytimes.com
nytimes.com
Oh look, they've got prism too!
> According to the website of its manufacturer, Prism “actively tracks the social media activities that result in increased social tension, disorderly conduct, protest sentiments and extremism.”
Well that's comforting.
This is obviously still in it's infancy, but they're only going to get better at this. Obvious leads and dead giveaways will be replaced with more subtly and variance, and detecting whats bullshit and whats real will become even more difficult, if not impossible.
This is russia's answer to people rioting over corruption in the government. Not transparency, not change; social manipulation of information and spreading lies.
And they aren't the only ones doing this. They're just the only ones we know about. No doubt other countries, companies and criminal organizations are operating similar tactics already.
Certainly puts a new spin on the term "don't talk to strangers"
And it'd surely be pretty damn profitable in the USA domestically to offer a service where a bunch of trolls would push your product, service, or candidate on the Internet.
(This comment may or may not be brought to you by the Russian Foreign Intelligence Service.)
http://www.usatoday.com/story/news/world/2013/08/14/israel-s...
We need to find a way around this ASAP, before it gets worse. And it will most certainly get worse.
(This message has been bought and paid for by... well, who knows?)
Rather, this is an example of how toxic the fear of it is. It's like that episode of the Twilight Zone, "The Monsters are Due on Maple Street," where the invaders only have to sow a tiny bit of paranoia and mistrust and watch people teach each other apart. Except in this case, there don't even need to be shills, the result would be the same either way.
It may be the case that it's impossible to save discourse, and the future is a world where brute force, power, and hierarchy drive which ideas dominate society. We'd be lesser for it, though, and I don't think we've explored many ideas for preventing that end result.
My point is only that our opinions are swayed and altered by propaganda, media, and the world around us in general. To say an opinion has been 'corrupted' is a murky concept to me, because I'm not sure how much of our opinions I believe are original, and what corruption actually means in this instance.
I'm surprised, frankly, that they don't have better English-language proficiency.
People with high English proficiency are probably employed at better-paying gigs.
And also seems to be testing disinformation campaigns in the US, such as spreading panic about (fake) disasters.
The Guardian comments sections are a trashbag of political censorship and general idiocy, but I see no evidence that they are being trolled by the Kremlin. A whole lot of people THINK they are, and the Guardian has levelled such accusations (without presenting evidence) but my own experience is that I am routinely accused of working for the Kremlin there, based on no evidence at all. Their view is simply "you disagree with me therefore you must be a paid troll". Making things worse: the Guardian moderators delete vast numbers of comments that would be considered completely acceptable anywhere else, merely for questioning what their articles say.
I think the only way to respond to government-sponsored trolling is to just ignore it. Who cares what someone's motivation is? The only practical response is the same anyway: answer back and be more convincing than they are.
Yet comments that violate the policy but agree with CBC writers views are allowed while polite, ad-hominem free dissenting comments are removed.
When there's too much dissent comments are simply closed.
For me the strongest evidence (still non-conclusive obviously) is the fact that the users who are heavily pro-Putin, while clearly being a minority on the forums, almost always get ridiculous amounts of upvotes. For example, for a typical political comment on the forum, getting 50-100 upvotes is rare, while these pro-Putin posts routinely pull 200-500.
All I can think is that psychological operations always have been part of war (and conflicts short of war), and the obvious place to conduct them in 2015 is not on leaflets dropped from airplanes, but on the Internet. I don't think it's conspiratorial to expect that nations are developing capabilities and training.
An analogy: do you know anyone who still falls for inheritance scam emails? Ten years ago, there were many reports of victims succumbing to fraud emails.
Of course statements like that evoke Godwin's law and a hard to swallow. However, my dad grew up in Soviet Russia and trained troops on the use of artillery equipment during the Soviet Afghanistan conflict. He's been around the block and has seen firsthand the Soviet propaganda in multiple Soviet republics.
If you think about the insidiousness of troll-style, FUD propaganda, it's way way more psychologically insidious than the overt Soviet propaganda. You can't cut off access to facts and appear "fair"--instead you make people question the truth.
Russia just raised a whole young generation that's a socially-backwards by a generation. Homophobic, racist, blame-the-west feelings are rampant.
During the early days of the Ukranian conflict, I was surprised to hear a close relative in Russia tell me how she has seen videos on Youtube of "blacks from Africa" killing innocent Russian youths ("gouging their eyes out" she said) in Eastern Ukraine.
This shit is real.
I was too born and raised in Ukraine, in Odessa. As many Odessans, we will never forget May 2nd, 2014 and will never forgive.
EX: Reefer madness vs. modern anti-smoking campaigns. http://en.wikipedia.org/wiki/Reefer_Madness http://www.usatoday.com/story/news/nation/2014/06/24/cdc-smo...
I find it deeply concerning how easily a modern state can alter how its population thinks. Outright lies are a lot easier to counter than selective truths.
If Russian propagandists are generally active in the Western media, it's difficult to view them as particularly effective: you'd have found more Western contemporaries willing to sympathise with Stalin than Putin, even during the McCarthy era, and Obama's approval ratings aren't doing too badly. I can't judge their effectiveness in Russian media, but I doubt that a particularly large proportion of the promoters of nationalism and bigotry are on Putin's payroll.... its not like their ilk is exactly nonexistent in the West.
Goebbels' message might have been more top-down and less subtle than Russia's social media spamming, but it did convince a reasonably well educated and well-to-do population that there was absolutely nothing wrong with rounding up all the Jews to deport, and convince the rest of Europe there was nothing to be particularly concerned about. That takes a little more effort than persuading Russians the West doesn't like them very much.
[1]to the extent that false explosion reports on September 11th can be considered cute
[2]Four mainstream British newspapers actually are owned by a wealthy Russian, though he's far too involved with Russian opposition parties to be inclined towards toning down their pretty standard critical editorial line on Russian policy
What is astonishing is its psychological effectiveness. It seems to encompass all levels of Russian society, especially the poorer people who are cut off from anything but the state TV, but also the middle classes. And the elite is wise to shut up and pretend to believe though they surely know what goes on. The conformity to social norms is so important: if you don't condemn the Kiev Nazis, you are a fascist yourself. Any disagreement will make even friends and family members turn against you, regardless of how good evidence you have for what you say.
I know Russians who live abroad and/or are net-connected and understand what goes on, but they are simply staying quiet, because they don't want to loose contact to their relatives and long-time friends. In a way, it's an example of "The Only Thing Necessary for the Triumph of Evil."
Of course statements like that evoke Godwin's law and a hard to swallow. However, my dad grew up in USA and trained troops on the use of artillery equipment during the Vietnam war. He's been around the block and has seen firsthand the US propaganda in multiple countries.
If you think about the insidiousness of troll-style, FUD propaganda, it's way way more psychologically insidious than the overt US propaganda. You can't cut off access to facts and appear "fair"--instead you make people question the truth.
USA just raised a whole young generation that's a socially-backwards by a generation. Homophobic, racist, blame-the-russia feelings are rampant.
During the early days of the Ukranian conflict, I was surprised to hear a close relative in USA tell me how she has seen videos on Youtube of "blacks from Africa" killing innocent US youths in Nigeria.
This shit is real.
And how do you think they spread that and maintained it once it was spread? Propaganda.
Still does!
Also! The article outs a couple of US-facing troll operations, one of which, "Spread Your Wings", is an unintentionally hilarious satire of US partisan politics, and another highly recommended read if you're up enough on politics to be in on the joke:
https://www.facebook.com/actoftruth?fref=photo
(My current favorite Spread Your Wings propaganda: GOP Senator and Presidential hopeful Lindsey Graham: warmonger and Adversary Of The 2nd Amendment.)
(Moments later: NO WAIT, this inspirational uplifting quote clearly wins the Internet today: https://www.dropbox.com/s/4r7r7nvbpn2kp3h/Screenshot%202015-...)
I run a crowdsourced news startup (https://grasswire.com), and along with it one of the bigger non-mainstream news Twitter accounts (@grasswire, 130k followers).
The Ukrainian conflict has died down a little bit, but when it was in full swing the Russian trolls were everywhere, and were pretty obvious, but that didn't matter.
For example, here are a couple of my favorites (and among the most active:)
https://twitter.com/gogigogi12 https://twitter.com/steiner1776
I'm pretty sure now they're mostly set to automatically retweet anything with a pro-Russian sentiment, but back in the day they would pretty much respond to every tweet. For the casual user it was very convincing stuff: "Oh wow, maybe @steiner1776 is right and that report was full of lies, and I just didn't know better - thank goodness I have someone who is willing to stand up for truth."
Most people don't have time to research, and just follow public opinion, even if the public opinion is created by a bunch of trolls. It's especially easy to fall for the trolls when they tell you that "the man" has been lying to you all along (and in most cases "the man" means the United States). (To be clear: The United States does some messed up stuff and is far, far from without fault.)
There were a few days when they would seemingly download photos from any tragedy that had ever happened, and just add a generic line - something like "Stop killing Donbass people," insinuating that these deaths were caused by the Ukrainian army (and by extension, somehow, the United States). The photos were from Syria, Iraq, Palestine, Israel - wherever. I'm sure they were just being pulled from some file somewhere with a generic message attached. But that stuff _exploded_. Hundreds of thousands of retweets per day, driving public opinion, based on complete and utter bullshit.
So there are some Russian trolls; this isn't the end of the world, right? The problem is that for many of the people on Twitter these were real people expressing legitimate concern. Some of their blatantly false tweets (they were easily discoverable to be such with a reverse image search) went legitimately viral (not just spun into their other accounts for retweets). Hundreds of thousands of impressions per tweet from people who aren't going to run a reverse image search, and get their news from Twitter.
I don't know what the solution is, but this is extremely dangerous for society. It's easy to pass them off as "trolls," but trolls change the way that people act and believe, even when they're only sharing false information.
We started Grasswire in part as a response to that. The fact-check feature on Grasswire isn't used as frequently now, but at the time about 50% of the stuff that went viral was completely and verifiably false - look at the history of the Grasswire Fact-Check account (@grasswirefacts) for examples of that. It helped, but I fear it was only drop in the bucket.
The game industry in collusion with "game journalists", succeeded in making people want less for their money. The dream of any big corp.
The subtitle is much more descriptive:
From a nondescript office building in St. Petersburg, Russia, an army of well-paid “trolls” has tried to wreak havoc all around the Internet — and in real-life American communities.
This linked to the wrong video, the actual link is https://www.youtube.com/watch?v=E2J6RvajSaA
Edit: He fixed it.
What seems funny that the behaviour of various workers is eerily reminiscent of various characters in Pelevin's "Generation P" http://en.wikipedia.org/wiki/Generation_%22%D0%9F%22
Calling them trolls is an insult to trolls.
I think some kind of web of trust, except this time for comments or social media artifacts, is probably the way to go.
https://news.ycombinator.com/item?id=9570202
What's the right way for a community to permit free and welcoming discourse and simultaneously blunt the ability of malicious actors intent on spreading disinformation? It's a hard problem.
If you feel like comments on a thread are coming from an organized trolling/shilling campaign, try to collect some evidence for it and then notify hn@ycombinator.com --- that's what they've asked you to do.
But don't start a conversation on the thread itself about how specific commenters, or even a particular style of comment, are being made in bad faith. It's the easiest criticism in the world for a troll to deflect: just start an argument that you're commenting in good faith and being persecuted for unpopular opinions. 100 comments later, the thread will seem to casual readers like nothing but litigation over who the commenters are. Mission accomplished.
Totally agreed that even the prior belief that trolling campaigns might exist is toxic.
Thanks, everyone, for the comments. They're thoughtful.
Yep. See also: Sue Basko and the Rustle League. The more she claimed they were a FBI/CIA Psyop, the more they laughed and poked at her.
We found no evidence of trolling (in the sense of subversive shilling) in that thread. As far as I can tell, one commenter was who he said he was—an individual who felt passionately—and other commenters accused him because they didn't like what he said. His passion didn't help his cause, but he didn't deserve that.
Groundless accusations of astroturfing and shillage are not allowed on Hacker News. If the only evidence one has is "these comments seem so wrong to me", that's groundless. Accusations based merely on the strength of one's own opinions cost this community considerable health points, and we're not going to let it become a thing. If it gets worse, we'll make a top post about this, explicitly ban it, and add a rule about it to the guidelines. In the meantime, please flag such comments.
HN has users with many divergent views. The community spreads across countries where perspectives and politics are different from one's own [1]. It's common for X to seem obvious to one user while ~X seems obvious to another. Occam has no trouble accounting for most of what people call trolling, astroturfing, and shilling in controversial threads.
When any of you have concerns about astroturfing, you're welcome to send them to hn@ycombinator.com. We'll take them seriously. We'll also be careful and stick to what we can find evidence for.
1. This cross-cultural aspect of HN is a big deal. We see it all the time; I think it's underappreciated.
It could just as well be one person stating his opinions. His opinions are controversal, and therefore they generate lots of responses (derailing) and he is downvoted because they go against what most people here believe. Doesn't quite seem like an army of professional "trolls" manipulating the discussion (If he is a troll, he would probably have presented his statements more effectively or subtly. The way he did almost guaranteed being downvoted).
Those "troll groups" are surely not a good thing, and you can never be certain this person wasn't one of them, but I also wouldn't label everyone I don't agree with a troll, just because they dare to write down their opinion, and my point of view is the one of the majority.
It really shouldn't matter if someone is paid to have an opinion -- if your own opinion is crappy enough that your only argument is that someone is being paid, then maybe they're doing you a favor by challenging your belief. Disinformation only works if you're too lazy to research the reality.
You'll never be able to confirm someone is a shill or whatever or not, so I don't understand why people obsess over it so much in comment sections. Just legitimately defend your view if it's that obvious.
The disinformation has an enormous advantage: It costs much less state a lie than to determine the statement's truth. I'm not lazy, I just don't have enough time to check the truth of all these statements. In the end, I have to trust someone.
On the contrary, an astroturfer might fail to persuade but still chalk their effort up as a success if they manage to derail a conversation. A bunch of people walking away from a stupid conversation failing to reach any conclusions is a win for something like, for example, Putin's govenrment.
That's like 95% of the time for 95% of people though.
I'm a black American from Chicago, and that's honestly a majority sentiment amongst friends and family, for what it's worth.
Putin is terrible for so many other reasons than this struggle between duelling right-wing nationalists.
I disagree with your opinion, but I'm glad you provided it. I wouldn't mind some support behind your assertion though.
It's a little odd to even discuss the desires of the Crimean population; they have no say in the matter.
I wouldn't worry too much - good moderation systems were built to handle these from the start. The places where paid trolls are likely to be most effective are also the places where you see the largest quantity of ridiculous posts from ordinary people. I'm thinking newspaper comment sections here, but Twitter might count too.
Whether someone is posting nonsense because they're paid or just because they can't sleep (https://xkcd.com/386/) the response to it is the same: robust forum software combined with people who point out their fallacies.
https://news.ycombinator.com/threads?id=yeahyeah
At the time this was the top comment and completely derailed the conversation. Pretty sure that wasn't a Russian agency, take a guess which one it was.
EDIT: amazing, I provide the community a crystal clear example of astroturfing and get down voted.
And we can continue this story until it comes back that it all started with the NSA.
... Until we learn that it is really an alien civilization that wants our natural resources trying to get us all to kill each other so they don't have to fight us?
I kid I kid, but seriously...