YouTube comments are heavily manipulated, and I fear for our democracy
rawrmaan.com
rawrmaan.com
The alt-right started with the mainstream media.
It goes back far before that. Even into this nation's early history; and all the way back, at least, to the Protestant Reformation.
Check out the Library of Congress image collection. You wouldn't believe some of the fliers (the "memes" of their time) published about Abraham Lincoln and George Washington. They make today's trolls and alt-right look like nuns.
This leaves us very vulnerable to manipulation by anyone who has even a slight edge in processing and disseminating large quantities of information.
I heard a very interesting comment on a podcast recently. This problem has traditionally been solved by intermediate organizations like universities, news orgs, political groups, unions, trade guilds, religious groups, etc. People selectively choose which of these orgs they trust, and then receive heavily curated information from those groups.
In the digital age, the influence and reach of these intermediate groups has been decimated / overshadowed in many ways. The proposed solution on the podcast was that we need to foster new ways of empowering individuals to connect with next-gen intermediate organizations in order to mitigate the Information DDOS. For example, Facebook could get out of the content filtering business entirely, and instead provide a completely agnostic platform that intermediate orgs could live on top of as a curation layer. People then choose which of those groups they receive content from. I think the idea needs more work, but I found it very interesting and relevant.
Of course, the intermediate orgs have not always done a perfect job, and have their own forms of manipulation and corruption. But throwing them out entirely without a proper replacement seems to be a huge mistake -- especially as the amount of information expands very rapidly, as is happening now.
I'm not sure that's a bad thing. Those intermediate organizations have been biased in the past and seem to have become increasingly biased to the point of becoming useless for those that want to focus on facts rather than opinion & commentary.
We know that widely available information is generally good for democracy. This could actually be a step in the right direction, but there is some adaptation that society has to undergo in order to efficiently filter the new influx of information.
Whereas before there was inherent trust of published info, I think a general skepticism over new information is likely to develop.
The problem we have today is not that information is widely available, but that disinformation is widely available and all but impossible to distinguish from real information. We're seeing time and time again, in elections across the world, that false propaganda spread virally through social media is having a meaningful effect on the way people vote. I, too, would love to imagine that a "general skepticism over new information" will develop, but we're not seeing any signs of that. If anything it's the opposite.
I also wonder how much of this 'fake news' people actually believe vs. using it as justification for their existing beliefs & non-rational biases.
Globalization, LGBT rights, open trade, open borders, etc. have happened relatively quickly and people resist change.
They can, yes. But we know who purchases them, and can make educated guesses towards the intent behind buying such a thing. For instance, the mass purchase by Sinclair of local TV stations in the US. We couldn't stop that from happening, but it meant that when there was a sharp shift in the news coverage those channels provided, we knew why.
> I'd argue that both Fox News & MS NBC are biased to the point of being useless for informational purposes and objective thought.
I'm not going to argue with that- like I said, the current system isn't perfect. But the likes of the NYT, BBC, WaPo, WSJ etc. do issue corrections on stories, and are held accountable, broadly, by each other and the public at large, because what they publish is public and known. By contrast, the new world we find ourselves in where posts can be advertised to specific audiences isn't public - not really - so there can't be any accountability at all.
Those intermediate organizations have been biased in the past and seem to have become increasingly biased to the point of becoming useless for those that want to focus on facts rather than opinion & commentary.
I'm not convinced that is true, but even if it were the important question isn't "are they biased?" but "are we replacing it with something worse?". So far, the latter seems plausible.Developing a general skepticism isn't a bad thing in and of itself, so long as it is tempered by the real goal which is to have a reliable mechanism for evaluating and accepting new information.
We know that widely available information is generally good for democracy.
This is only true if the information is correct, and quite the opposite if we are talking propaganda etc.https://www.huffingtonpost.com/entry/safe-spaces-college-int...
But the best propaganda is true, or at least points to the truth. Does that mean some truths being widely know are bad for democracy?
By all means clear communication of facts is beneficial for democracy. But that is not what propaganda is.
[edit: dragonwriter pointed out it is not strictly necessary for it to be misleading - this is true and not what I meant to suggest. In practice nearly always is misleading. It's purpose is to manipulate, which is always detrimental to democracy imo]
No, propaganda is designed to influence belief and behavior in a particular way (the defining example was material designed to lead people to the Catholic faith; “propaganda” comes from the former [pre-1967] Latin name of the modern Catholic Congregation for the Evangelization of Peoples [0]); it is not necessarily intended to be misleading.
[0] https://en.m.wikipedia.org/wiki/Congregation_for_the_Evangel...
Think for yourself, dammit. It isn't that hard.
I'm not an expert on climate change, but it's an issue that I may care about. So what do I do? Drop everything and spend the next 10 years becoming an expert?
It wasnt like people didn't have the ability to think for themselves before the onset of an unfiltered internet.
Everything you know that you didn't experience yourself comes from other people.
I think for myself plenty. I have realized that it is foolish to completely abandon accumulated collections of knowledge and wisdom and try to do everything from scratch by myself. Yes, they have flaws, but everything has flaws. Any alternative framework or approach must do significantly better with less flaws.
Of course, constant effort is required to reevaluate things, to account for known flaws, and so on. I would never advocate for docile, naive acceptance of authority.
Edit: I should have also mentioned that I'm a strong proponent of applying a reasonable degree of skepticism to all incoming information, as well as being comfortable with uncertainty. Saying "I'm not sure about that but I'd like to learn more" is a superpower.
Perhaps the best platforms of the coming decades will succeed by providing very powerful tools that enable intermediate orgs to more effectively scale up alongside the massive flow of information while remaining true to their core values.
Reddit is probably one of the best examples right now. But I think it is only a glimmer of the potential.
I also think that we have to somehow remove the incentives that push for blindly increasing "engagement" at all costs. The obvious targets being digital advertising and the grotesque, anti-human ad-tech industry that it has spawned.
According to On Tyranny: Twenty Lessons from the Twentieth Century by Timothy Snyder, democracies fail all the time easily. You go to sleep in a democracy, you wake up the next morning in a fascist state. You lose rights, you lose the ability to vote in elections, and then within a month you're in a "state of emergency" aka a fascist state for the next 12 years (Germany) or still to this day (Russia). Snyder's book shows that tyranny or fascism is a deliberate systemic process.
Link to truth decay article: https://www.cnn.com/2018/06/19/opinions/truth-decay-opinion-...
While not a complete list, I look at https://old.reddit.com/r/PoliticalDiscussion/ and https://old.reddit.com/r/NeutralPolitics/ The latter, especially, is heavily curated. The former is, I think, fair.
I've noticed many instances of this and usually, I like looking at comments to find different views or different opinions but sometimes it's a bit too unanimous. I have a suspicion that many of the top comments are fake and made to look like a bunch of random people commenting on the video when it's really a group of people that are trying to change how people think. Which sounds silly but people follow the masses, if the majority of YouTube comments are saying that x thing is bad/good, then people just see that and start believing it as fact since everyone else seems to belive it. I mean the entire comment section is saying that x person is bad, plus there's 100 upvoted on the first comment going into why that is, sooo it must be true :P
Sorry, seriously though, have you noticed this with HN comments? I sometimes get that feeling when browsing here, I really notice it on the comments that immediately flood in when Apple are having a conference....
This type of operation sounds silly until you realize you could push your agenda to tens of millions of unique people reading the comments section on YouTube alone. If this idea sounds crazy, just remember the recent US elections were found to have a similar scenario occur with fake websites being pushed on various social media platforms and eventually people believed and trusted the articles written on the sites and started reposting, liking, etc. the fake news.
"have you noticed this with HN comments?" As for HN comments, I don't spend a lot of time reading through comments here to know. I'd assume that it happens on every social media platform. If this is occurring on YouTube, Facebook, and Twitter, then every platform is in the targets. It's all about the eyeballs, so I'd be shocked if there weren't already thousands of fake accounts already opened either aging or already in use on HN. If I were running this type of operation, I'd have thousands of accounts on each platform: Pinterest, Twitch, Quora, TikTok, Snapchat, you name it, I'd have it. If it has millions of users per month and is a social media platform where discussions and opinions occur *or might occur in the future (new potential features on places like Snapchat), you better believe I'd have accounts on it.
Either way, it's not a random sample, which is what you'd really need to gauge average opinion.
YouTube is not. It's a website that everyone uses, and where the most impressionable or least politically aware members of the population are the most numerous, easiest targets.
However I will say that Engineers, good ones, are accustomed to being wrong and taking the initiative to change their thinking.
> The volume of comments that are processed
> vastly exceeds what human moderation could possibly do
For every 500 comments, there is one video. For every 50 videos, there is one Channel with a Google user behind it. Force creators to handle the complaints about comments on their videos... an order of magnitude less work.I've gone into this before and there really seems to be total buy-in here to the idea that these companies couldn't possibly manage to weed the toxicity off their platforms. I don't believe it for an instant. It's true only if you refuse to entertain any decrease of "user engagement". If you are willing to lose some eyeballs, the problem is manageable.
And that sacrifice, in the case of YouTube, isn't even a sacrifice! YouTube would wind up with more users if the comments weren't so toxic. Susan et al just don't have the courage to change anything.
In practice, this will result in YouTubers disabling comments on their videos because most creators don't want to play moderator for toxic assholes.
... I'm okay with this. ;)
> And Hacker News comments are any better?
The most significant difference is that comments on HN tend be intelligent, well-reasoned and courteous, whereas comments on YouTube tend to be the psychotic rantings of paid trolls, foul-mouthed children, and hate groups.Yes, HN comments are better.
Like you say: I think it's a waste of time to condemn entire platforms - there are really interesting people in these places that can be always discovered. Here and on YouTube. Just be aware that there you might occasionally find yourself in a zone besieged.
For example, that's how it can become possible for a politician to get elected who openly advocates torture or extrajudicial killings.
Without some corroborating evidence, these claims don't hold any weight. It's not that they're necessarily wrong, it's that there's no way to tell. Imagination produces just the same perceptions, and there is a ton of imagination going around.
Occasionally we do find evidence, and then we can do something about it. Absent that, though, the default explanation has to be that you can simply see anything in anything, especially when emotions are involved. Note the "I fear" in the title of this submission.
What's frustrating is that users don't have access to most of the data, making it harder to look for evidence themselves. They have to rely on someone else to do it and then trust what they say. In a low-trust social climate, that's working less and less, which only fuels more imagination.
So if a channel is fairly obscure and doesn't focus on politics, the comments can be... bearable.
But anything remotely popular is a hive of scum and idiocy that most people will rightfully not touch with a fifty foot bargepole. Less political there just means more 12 year olds posting outdated memes in place of the Russian bot farms and political trolls.
When I watch youtube videos of a technical nature, there tends to be much higher-quality comments.
I thought the article was insightful and brought up a relevant issue, and I'm not sure what boat you claim it's missed.
This is likely just simple incentives:
- Google uses comment count as a measure of video engagement
- Monetization is based on engagement
- Content producers are therefore incentivized to generate comments
- Controversy is great at generating comments, so content producers get creative
And the article is not about kids; if you made it to the end you'd see implications for e.g. the November midterms in the U.S.
EDIT: Was able to watch it. This looks like a bug more than anything.
Eventually, we won't be able to distinguish between real humans and bots online. No CAPTCHA will work, no Turing test, none of that stuff.
Message authentication (e.g. keysigning, or a centralised provider you trust) works for individual identities that you're already aware of, but the general case of trusting comments online?
Even without all of that, you've never had any idea whether the "person" replying to your comment is paid, or has a bias, or whatever else.
If, say, 30% of Hacker News commenters were "fake" in that future scenario, would we know? How would we know? Once we develop a method, can't that be gamed?
I like the approach projects like Keybase and Stellar are taking: Building a decentralized network of trust based on existing, real-world trust-based relationships.
What do you count as “fake”? Actual bots, sure, but what about a real person running an automation that spams overnight? What about many real people mass-typing “opinions” on behalf of someone who pays them? What about a single businessman typin a falsehood that helps his business? Which of these count as fake?
b) All of the ones you've mentioned, at least. I deliberately didn't define it because I think it's difficult.
Absolutely nothing, unless diverting attention counts. A few product announcements, something something net neutrality, a little more "juice" for every possible news item with an anti-Facebook or anti-Twitter vibe, and voila! Nobody's talking about YouTube any more. They're in the attention business, after all. They know that letting attention dissipate is their best strategy in this case.
In a better world, they'd be using some of those vast resources and ML expertise to detect the kinds of vote/comment clustering that signal both commercial and political manipulation. Others have done it already. The fact that the self-styled "best and the brightest" are way behind on this says that they don't have the interest.
Others with the same number of accounts and daily visits? With the same flowrate of publications and comments?
Disclaimer: I work at Facebook, though I'm only involved in those efforts to the extent that I work on the data-storage systems that support the data scientists.
If you want people to endorse the veracity of your scam, you'll have to pay. Want them to endorse the veracity of claim you've just made up about $politicalentity and you won't...
That will have the effect of said news outlets being extremely scrutinized.
At the same time, any platform such as Twitter, IG & FB should be made illegal worldwide. The only content based platforms that are fine would be heavily scrutinized educational platforms where no politics are allowed.
I know it'll likely never happen. But what about 1000 years from now? Maybe so.
There's no other way around it. Information is power, and those systems are ripping apart humanity.
The printing press and propaganda were/are also obviously bad. BUT. If they were made hyper transparent, hyper centralized, and obliged to follow a few rules such as clear labeling, it'd be way better imho.
Said news outlet should be just one. Regulated by some new UN entity.
By a certain measure that may be true, but if you were to actually measure how often people read and post comments, and what percentage of users do, I think you might not reach that conclusion.
There is a social media aspect to YouTube, but I don't think that is its main function for the vast majority of users (who are probably better described as "viewers").
(that said I think the article is good, and YouTube comment quality should be an embarrassment to Google)
Like the marriage in the aforementioned hypothetical, left of center politics is failing worldwide for other reasons, not because of some nefarious social media plot. People are growing fed up with government as an entity, and as a result, they want less government in their lives. Over the past few decades, the practiced manner of a politician became something that was mimicked and parodied worldwide, and popular culture widely regarded the politician as a crook for far too long. Even some of the most charismatic leaders who were beloved worldwide - most recently President Barack Obama, have been wrought with scandals like Snowden's NSA revelations, and the weak and dishonest manner in which the President responded when the activities of the intelligence agencies were exposed. Even during his first term, he made the (perhaps superior) decision to bail out the Wall street banks, and was subsequently betrayed by the various corporations who gave large payouts to top executives. To working class folks, these things are unforgivable especially when they come at the hands of someone you admired, even loved.
The trust in government as an idea is so low that all someone has to do is stand up and say "these crooks and rascals have lied to you all your life. They have practiced and poll-tested speeches but I am honest, raw and I speak from the heart. The fake and dishonest media there will tell you that I am a thug and I have said this and that. I am a thug, but I am your thug, give me a chance to show these crooks how it's done". The public will fall in love, because after what so many parts of the world have witnessed from their governments for so long, this kind of talk is like sweet seduction.
This kind of post "I read YouTube comments written by bots and the world is going to end because my party lost the last election and they may lose the next one" are disappointing. People can vote for political candidates based on any whimsical or nonsensical reason be it race, religion, "he has a kind face" - whatever they want to. Voting is an individual right. Any attempt to influence a voter - whether it's a bot farm or a person writing an article to stop a bot farm, means only one thing: "I want this person to vote the way I vote". Democracy needs a free market of ideas. No number of botnets are going to convince me to vote for someone who espouses nazism, or worse, communism. If someone else is swayed, it is their right to be, that's okay. Great ideas will win in a free market, bots or no bots. All ideas, no matter how objectionable, should be heard.
This is a slogan, not an empirical fact. There are plenty of instances of market failure in cases where information about goods is unreliable or manipulated. It's a whole sub-discipline in economics!
In the case of politics, actors have a strong incentive to cause the information market (if you want to put it that way) to fail.
I suspect a lot of cognitive dissonance is evolutionary survivalship bias of "don't question the big man with the club/sword" and also why public speaking is commonly feared worse than death - because it could kill more than just you in barbaric days.
To the extent that people engage in any format, propaganda in that format is concerning. And like it or not, people do engage in YouTube comments.