They - or any other social media company - don't have a right to exist. If societies around the world conclude they do more harm than good as they currently operate, it's perfectly reasonable to require them to moderate adequately. If they cannot they can close, or withdraw from that region, and someone else may wish to try. Facebook could employ thousands more to moderate and supervise - without destroying their ability to make profit. Pretending the problems don't exist, as all the platforms have done so far, looks like it's not going to be tenable for much longer.
Not only am I fine with that, I think it long overdue.
Millions of people were eating adulterated food every meal prior to food regulations. Political process and advertising was rife with corruption prior to attempts to instil a semblance of fairness limiting what was allowed and when. Yet people attempted to vote before this.
Attendance absolutely proves something when it comes to social media. You can't make a comparison between social media and food because one is necessary for survival and one isn't (I'm sure I'm going to invite a ton of comments here on how 'Facebook has become so ubiquitous and powerful it's now synonymous with survival!') If the negatives really outweighed the positives people would be leaving Facebook by the droves. It's only on HN and in the news media that this narrative is being spun.
I am claiming your statement "and they feel perfectly comfortable" is unknown. Further that it is highly unlikely.
Many is not most - it probably is most of my friends and relatives, but they are representative of nothing at all. Yet there is now a certain discomfort in almost all discussions of Facebook - no matter where that takes place - that simply was not there 5 or so years ago.
Yes, it proves that network effects can force people into bad equilibra. If you think high university costs are harmful for society in the long run, but if you personally don't attend you will incur significant cost in the short run, with nobody cooperating, how do you behave?
Not really - I would love to be able to delete my account from Facebook but it's the only place some people that I want to keep in touch with will use.
(I did the next best thing - deleted the apps and only check the website infrequently.)
However, it remains the office of government to introduce enforceable regulation in this (or any) space to protect their constituents, and hold those in violation accountable. I don't suspect it's an easy task, as the problems are broad and can be a grey area. I.e, some of the problems with Facebook stem from mischievous users -- exactly how accountable the platform is for their behavior isn't universally agreed upon.
I think if rules of engagement happen, people will have less problems with just letting the market decide.
No reason Shitbook shouldn’t be held to the same standard.
So we should shut down the mosques in New Zealand because they didn't control their premises and keep the shooter out? Should we shut down banks because they didn't have enough security to keep a bank robber out? You are shifting the blame away from the perpetrator. Every crime ever could be blamed on the victim for lack of security.
I am placing additional blame on a medium that isn't willing to exercise adequate restraint or control.
A bank undoubtedly has security measures in place to prevent robbery, if they don't bother, they won't last long. Nonetheless, there are regulations on what may and may not be done for public spaces, how crowded they may be to pass fire regulation and so forth. Neither a mosque nor bank should be closed for a circumstance that could not reasonably have been predicted.
How is this any different from Facebook? A bank has security measures in place to prevent robbery, but a robbery could still take place in one and is more likely to occur in one because it's a high value target. Facebook has human and AI moderation in place that automatically processes anything you upload. Users are also able to report content. However, just like sometimes banks are robbed, sometimes objectionable content slips through their filters. By your own logic Facebook shouldn't be closed down because mass shootings cannot be reasonably predicted. The basis for your argument is fundamentally flawed and if you extrapolate it to your own examples you'll quickly see how ridiculous and illogical it is.
Youtube, Instagram, Facebook, Reddit have size and reach enough that turning a blind eye is no longer credible. We've seen countless issues crop up with regard to elections, election advertising, hate speech, and in this case broadcasting a slaughter. All of which serve to demonstrate they are unwilling to self-regulate taking them into territory where it's clear current regulation is not adequate.
Calling for adequate regulation to require moderation and oversight, and to require a duty of care to their users, viewers and listeners is not calling for them to be closed down. That comes if they prove unwilling to obey said regulation, as does any of the other measures brought to bear against habitual law breakers - fines, asset seizure, blocking etc. Regulation that will vary between different countries as they will choose differing limits.
Primarily because we’ve been telling them they need to do a better job about this for years, so “could not reasonably have been predicted“ absolutely does not apply. They have literally been condemned by a United Nations investigator for what happened in Myanmar [1]. Multiple government have been unhappy with their attitude problem [2]. In this report, one of the problems is they “continue to host and publish the mosque attack video”, which they absolutely don’t have any excuse for not being aware of, not any more.
If this is the best that the state of the art can manage, then the state of the art is not good enough for Facebook to continue to exist. If Facebook were a human, it would have been fired for gross negligence.
[1] https://www.theguardian.com/technology/2018/mar/13/myanmar-u...
[2] https://www.theguardian.com/technology/2018/oct/31/uk-and-ca...
It's a fair question to ask, "If a company is that profitable and having toxic effects, then why shouldn't it pay some of the cost of addressing its toxic effects?"
The tendency on HN is to say exploitive governments want to tax technology startups.
But we're not talking about technology startups. We're talking about the new old-old ATT.
cf oil or chemical companies polluting via spills, etc.
A better question would be, should a bank be held liable after being robbed if it failed its duties by designing cheap systems to save money — yes. Should a mosque/church be held liable if they received a threat and they ignored causing large loss of life — yes.
Facebook is culpable. They know the kind of garbage that floats in their platform. They continue to develop their platform and they continue to improve their ad systems. Why won’t they dedicate as much engineering effort to gain an advantage on racism/hate speech/fascism? I’ll tell you why.
Because Zuckerberg simply does not care. He owns the platform that dominates information flows and public discourse. Why would he undermine that?
What about this : all content is potential knowledge and should be made available. That way no one get to decide what is "acceptable content". At the end of the day, the laws still forbid anyone to kill people, content or not.
A good read is : https://freedomhouse.org/report/freedom-net/freedom-net-2018...
You're underestimating the scale of this problem.
Facebook users create billions of new posts a day. And, tens of millions of these posts get reported for moderation per day.
"Thousands of more" employees isn't going to solve the problem. Assuming each posts takes 10 minutes of labor to review, you would need an army of 200K individuals, and this amount of labor would cost many billions of dollars per year.
>> Pretending the problems don't exist, as all the platforms have done so far
You must be joking. Facebook has already made massive investments into moderation. It's their top priority for 2019. In many ways, they are doing the opposite of pretending this problem doesn't exist.
>> They - or any other social media company - don't have a right to exist.
Nobody is arguing that FB has an inherent right to exist. The only point GP made was that (as made evident by your comment) many people are underestimating the associated costs with manual moderation of content.
Agreed. Let’s require them to do that.
I could go find the shooter’s illegal manifesto and post it here, I might be banned after some period of time but just like on Facebook it would have had time for other people to see it.
Applied consistently this standard would kill most online forums and that type of thing.
Just as software engineering practices need to change for the big names compared to everyone else, so do social practices.
You'll almost never see far-right content any more.
I'm sorry you've internalized their bullshit, but that's what it is: bullshit. They can do it when it sells ads or stops someone senior going to jail.
Yet they can attach an ad to it in a millisecond. They’re incentivised to do one and not the other. These bills are about rebalancing those incentives.
According to a 3-month old article, $FB supposedly employs 7,500 moderators [0], though it's unclear what constitutes "employment" in this case. Probably a salary of less than $5k/yr. Are there really thouhsands of content moderators pulling up to FBHQ in Menlo Park 5 days a week? I don't think so, no.
[0] https://www.inc.com/christine-lagorio/facebook-content-moder...
That number has only increased in recent months and will likely continue to increase in the near future. Not all of them are designated content moderators, it's true, so technically they likely only employ one or two "10s of thousands", but I'm mainly addressing the misconception in the thread that Facebook is "doing nothing." That's a significant amount of moderators. Is it enough? No, but to claim or pretend that they aren't actively doing anything is facetious and something I've been seeing more and more of on HN lately.
[0] https://www.theverge.com/2019/2/25/18229714/cognizant-facebo...
Forums have managed to keep undesirable content at bay with often no budget at all, so anyone claiming Facebook can’t do the same is false. They don’t want to do it, because abusive content still brings them clicks and ad impressions (remember that for every nasty piece of content that turns into a PR disaster there are thousands that go unnoticed but still generate money for them).
What forums are those? Because this isn't the case with the forums I frequent. The boards I read / participate in tend to operate on the principle of "don't make me come over there", and everything is reactive, not proactive. I'm not sure how you'd get things like "user was banned for this post" etc otherwise...
I don't have a problem with moderation being delayed. I have a problem with there being no moderation or clueless moderation (I have reported hundreds of obviously fake accounts or pages promoting outright illegal activity, and the majority of those got ignored).
Of course, the scale was much smaller than Facebook, but my point is that maybe if you can't solve this problem then you shouldn't be in a position to broadcast & promote stuff to the entire world? The danger of Facebook (& other social networks) isn't in your friends seeing your malicious post, it's that your malicious post can go "viral" and be put in front of people who haven't asked for anything since the ranking algorithm is based on stuff like "likes", shares, etc (and a lot of garbage content tends to attract likes unfortunately) which can also be manipulated by a determined attacker (using fake/compromised accounts to "like" the post, etc).
Nothing is visible until it's been validated. Guardian comments still do this for some topics.
With all the assorted profiling going on, I'm sure just as some users (like via Tor or VPN) are automatically given harder Google captchas, or some boards make you earn enough karma to perform certain actions, reactionary moderating could be something you have to earn, and sustain. Perhaps certain interests would trigger proactive moderating too.
Not perfect but certainly capable of taking much load off human moderators.
Don’t you think they would, for example, be able to prioritize content based on reputation/hidden metrics?
Don’t you think, for example, that a fair amount of videos categories can be auto filtered with extremely high accuracy?
Don’t you think, for example, that if they had enough content moderators they would have been able to stop the stream and to take down this video faster?
Do you really think I am proposing that they review every video in FIFO order? Or did you want to reduce my proposal to that so you can easily dismiss it.
What you're proposing is discrimination and isn't a solution.
> Don’t you think, for example, that a fair amount of videos categories can be auto filtered with extremely high accuracy?
No, not really, but please provide some examples. I'm assuming you mean content category, not literal tagged category, in which case you can't really distinguish between someone livestreaming in their car vs. the Christchurch shooter driving up to the mosque.
> Don’t you think, for example, that if they had enough content moderators they would have been able to stop the stream and to take down this video faster?
Sure, but they already have many thousands of moderators in addition to automated systems in place today. It's inevitable that unless every post is hand-reviewed by a human that some objectionable content will slip through.
I get that your point is that FB and the other big tech companies can certainly afford to be doing more than they currently are, but to the extent that we would almost certainly be in this exact same position even if they had hired your proposed 50,000 moderators there's not much substance to your proposal that I can even reduce.
Like rank/derank the feed based on contextual clues? No way this wasn't the first thing done.
> Don’t you think, for example, that a fair amount of videos categories can be auto filtered with extremely high accuracy?
They've touted high accuracy in "using AI" for content moderation, like 95% or 99% or something. i.e. using machine learning to automatically tag content.
> Don’t you think, for example, that if they had enough content moderators they would have been able to stop the stream and to take down this video faster?
So your proposal boils down to "hire more people so more content can be filtered faster". GP perhaps didn't steelman your argument for you but if your proposal were to be applied the only real delta would be workforce size. It follows that your proposal in effect reduces to "hire more people".
1. Online services should maintain an acceptable legal and moral standard of the content they serve. 2. Online services should be able to profitably facilitate the communication between millions and billions of users.
Which of these concerns seems more important to you, regardless of what you believe is an acceptable legal and moral standard?
Car manufacturers can't prevent accidents - what do you mean?
I think social media are at a point when they are forcefully downplaying the social issues which they are actually responsible for. We've already seen state and other actors exploit the social media and cause mass epidemics; anti-vaxx, white nationalism, Rohingya issue etc. to name a few. Let's see how far it goes before the damage is too much.