Sometime in all of this, Russia must have taken notice (or was quietly in the picture the entire time) and started spreading misinformation for the purpose of division rather than clicks.
I have a few thoughts on all of this. First off in a way I sympathize with all the folks running content farms abroad. You have to respect the hustle and ingenuity. I also think that much of this fake news is on Americans for eating the shit up.
One thing that has always bugged me about the narrative of "fake news" and "disinformation" or "misinformation" online is that it always made the readers/consumers seem like helpless victims. It's always "we have to stop misinformation", "we have to stop these troll farms", never "we have to educate ourselves to be more savvy". The narrative seems to be that the readers of this crap have zero agency, and we have to go out of our way to protect them from his harmful information.
I see your point but I don't necessarily agree. A major aspect of a healthy society is trust. We need to be able to trust most of the informations that are fed to us in order to get information. Navigating a trustless information landscape is incredibly time consuming as looking for sources and invalidating information is much more time consuming than producing it.
Requiring people to stop acting on their "outrage" feeling is also extraordinary damageing to society as it also stops people from reacting to actual issues.
Finally, if you look at the savvy people do you really believe that they are actually better at detecting fakes? It seems that they are better at identifying information sources that can be trusted, but once trust is established I'm pretty sure they don't spend all their cognitive resources trying to disprove everything they read (well some probably are).
So a bit like with malware being more abundant on more popular OS, even if everyone moved to reputable sources, the trolls would move as well.
Another major aspect of a healthy society is distrust. People trusting anything they see written down is a major issue for a healthy society. This was rarely discussed when everything that was written down was controlled by the large media conglomerates, but it is becoming a huge point of contention today. Traditional media are furious that they are losing their unique ability to shape publish discourse, and are desperately lashing (there was a NYT article outraged that some site was permitting the creation of private rooms with no control of what is being discussed).
I don't believe in censorship either but we need to find a way to disincentivise behaviors that lower trust.
You missed the root cause. The mainstream media lost the trust of the people with their biased reporting. This leads people to look for alternate resources, which are being manipulated like this.
Well, it's both:
* For misinformation spread through centralized media (TV, radio, newspapers, etc), we do need to stop it, because the privilege of running a media company comes with responsibility to not spread misinformation. The same applies to any official government channels.
* For misinformation that spreads person-to-person, we do need to address people's lack of ability to think critically and search for truth. This is a long-term goal that can be achieved by teaching critical thinking classes (like philosophy) in K12. Finland is taking this approach already[1].
Social media like Facebook falls somewhere in between. To the extent that Facebook can act as a media company (e.g. by providing a platform for groups with membership in tens of thousands), it should have the same responsibilities as TV stations and newspapers of comparable reach (in my personal, biased opinion).
While it doesn't make sense to stop people telling things to each other, it does make sense to go after the hubs where misinformation originates and spreads to many people at once (in my biased opinion).
When it comes to individuals, well, that's why we need educational reforms.
Side note: the entire point of Russian propaganda/misinformation campaigns is not to spread any particular viewpoint, it's to destroy people's ability to search for truth (everything is fake, might as well pick what resonates the most!), reason critically (bad faith reasoning 101), and hold a civil discussion to find common ground (any disagreement can be won by making the other person angry).
It is self-sustaining; affected people start coming up with their own alternative realities which spread like wildfire. Tribalism and fake news are the result.
[1]https://www.weforum.org/agenda/2019/05/how-finland-is-fighti...
I agree with the "ought" here, but don't think it's practical.
I think it's more likely that "democratizing" misinformation/lies/propaganda, combined with online anon- or pseudo-nymity, is simply a (strong) net-negative for, especially, democratic states, as much as we really really want it to be net-beneficial, and as much as we can imagine a world in our heads where it's net-beneficial. I think it may simply not be what we hoped, and not be practically able to ever be that.
> Sometime in all of this, Russia must have taken notice (or was quietly in the picture the entire time) and started spreading misinformation for the purpose of division rather than clicks.
Not even. Russians noticed it and did the exact same thing, but everything that happens in Russia or is done by someone of a Russian ethnicity is connected to the Russian government when reported on in the US/UK.
I don't think you do. They're parasites, scarcely better than email spammers or petty criminals.
I don't know if this is actually the case everywhere, but I would assume it's the case in many places.
Whenever they started doing that specifically through false-front Facebook groups, Russia has been doing that to the West nonstop, through most media that it could conceivably be done, since it became an independent country, taking over from the USSR which had been doing it for generations previously.
Somehow things like Russia Today are presented as blatant propaganda, while Radio Free Europe is neutral reality. Both are propaganda.
No, I’m presenting it as if Russia was the topic of discussion when I joined.
> Anything Russia is doing on this front is dwarfed by what the US, UK, France, Germany etc. are doing.
Now you are falsely presenting it as Russia being uniquely moderate in this regard.
> Somehow things like Russia Today are presented as blatant propaganda, while Radio Free Europe is neutral reality.
RT and RFE are both propaganda, the latter more openly so, not less.
But the discussion here is about false-flag propaganda, not things like RT and RFE.
Unless you live entirely in their Messenger app, which I do. The timeline is full of contraganda, spam, and things like `Tell me your favorite color without saying it` bullshit
Took me about 2 weeks of hitting hide from content farms to train the algo to steer me away from that junk.
I wonder why they’ve never done that…
Unlike spam, the content farm spreads organically.
I'd argue that the only meaningful benefit (to me at least) of Facebook is as a contact list and finder. I would delete my Facebook instantly if I felt fairly confident that I wouldn't lose out on any outreach from less-than-weekly acquaintances.
That's not true. It's actually the most effective grassroots-politics tool out there, for "regular people". Everyone has an account already, so signing up to this or that group takes seconds and you can get down to the business of actually organising.
I saw it recently in my neighbourhood: local authority wanted to push a stupid change in road layout, a couple of guys set up a FB group, and in less than a month it had hundreds of members - the road change was protested so vigorously that it had to be scrapped, something rare around this town.
Am I annoyed by this state of things? Heck yeah, I hate FB, but realistically, it's often a force for good for "normal people".
Facebook's overt business model is to be a platform for advertising (not just via overt ads, but also through paid reach of what looks like organic content). “Advertising” is just another word for “propaganda”.
So, you've noticed that Facebook “now seems to be” exactly what Facebook overtly is.
Facebook appears to be nothing but clickbaity ads, which if I'm lucky, is trying to get me to buy something I don't need. If I'm unlucky, it's ideological poison for hire fueling culture wars or foreign agents meddling in elections.
I basically never use Facebook now, except if a friend asks me to post something, but whenever I do, and scroll through the timeline, I always end up depressed. Oh and yes, bombarded with all the weird stuff discussed in this thread.
On the YouTuber front there were more than one who jumped on the alt-right shock jock bandwagon back then for the same reason. It brought clicks both from the people attracted to that stuff and from the people outraged by it or just gawking at it.
It's a never-ending cycle that benefits both parties.
FB feels like it should be a public utility. It is clearly filling a niche that people feel is needed. The barrier to entry to use is very low. I've encountered so many people who simply don't use other parts of the Internet much at all, and expect almost all content to be mediated through Facebook.
FB will still prioritize things that generate interactions. So if little bits of controversy slip into the DIY discussions, that's still what bubbles to the top of everyone's feed.
It hasn't necessarily happened to your group, it may not necessarily happen, but the point is that this is what the algorithm was optimized to do.
“The content isn't violating or borderline. It does skew very hard towards clickbait and engagement bait, however.”
“The religious pages tend to be a mixture of the heavy engagement bait like the meme from “Light of the World” and sensational click bait stories about children, animals, and police officers.”
“Why Do They Do It? Money is definitely a big reason. There are a few ways to monetize an FB page.
1. Link to a domain where you show ads
2. Enter into our partnership programs
1. Instant Articles
2. Ad Breaks
3. Do sponsored posting and sharing4. Sell the Page after it reaches a large size.”
“Mostly, they seem to want to skim a quick buck off of their audience. But there are signs they have been in contact with the IRA... If the Troll Farms are reaching 30M US users with content targeted to African Americans, we should not at all be surprised if we discover the IRA also currently has large audiences there.”
The last quote is the one talking about potential political links. There are some serious concerns, but not as concrete as the claims made by the article.
I appreciate your caution about jumping to assume the motives are political, when financial motives on the internet are of course so common.
And who would be behind it if they followed the money? My money is on parties like the Heritage Foundation, which is a quite open front for rich conservatives to pump money into certain goals, and I'm sure there's plenty more that have escaped the spotlight for now.
I mean yeah it's a conspiracy, but since it's in broad daylight nobody cares - it's not shady if it's out in the open.
Advertisers, probably. I worked in adtech doing fraud detection back in ~2013 and “fake news” sites were already prevalent, but their business model was usually boring old advertising. They were also big on ad fraud (e.g. serving ads in hidden iframes).
That’s not to say that the Kremlin/IRA were not behind some of it, but Occam’s razor is that most fake news is just a result of sites with no incentive to do honest journalism trying to drive clicks.
This is more likely Eastern European scammers who are just looking to build an audience any way they can.