Why do companies with unbounded resources still have terrible moderation?
moultano.wordpress.com
moultano.wordpress.com
There is a discussion below about Flat Earthers having every right to speak -- and I agree. And in fact, I doubt anyone would truly care about Flat Earthers having their Flat Earth forum or even adding an occasional Flat Earth comment whenever NASA posts a round Earth photo. That's never been the problem. The problem is that some users don't stop there -- they're on a mission to change the world. They going to abuse your platform to the extreme to promote their views. Most big platforms right now have a huge mess of people tossing free bytes at each other.
If a small group of dedicated people wanted to ruin Hacker News for the rest of us, I have no doubt in my mind that they could. No amount of moderation could stop them. I've seen it first hand a few times with other services.
Facebook and twitter _encourage_ people to abuse their platform, that's why you can write 100 tweets from one account on a single day and they don't try to stop you at all, they know all that content will show up in their statistics, it will also make other users reply to those comments and so on; so in the end they have all incentives to keep their platform filled with people enraged with each other.
>If a small group of dedicated people wanted to ruin Hacker News for the rest of us, I have no doubt in my mind that they could.
I'm not so sure, unlike Facebook HN is not a for-profit (Ycombinator is, Hacker news is not) so something as simple as only allowing comments from user accounts created before the attack started would mitigate the problem until a better solution is slowly deployed.
Also, Facebook cannot ban an IP because other non-attacking users may be using that very same IP, a little site like HN loses nothing by banning offending IPs, a site like Facebook would get a gigantic backlash that would hurt the bottom line: Their valuation.
I mean you could try to keep up with Tor exit nodes and VPN gateways but pretty soon you'd be banning all of Azerbaijan or something.
They would gain nothing either, since you get a new IP address every time you reset your router or connect to 4g.
My original point is the equation is actually the other way around; mitigations on attacks will ultimately require more energy than the attacks themselves. For you it's exhausting, for them it's exhilarating.
You can fight back by intentionally disadvantaging the top percentiles of an important metric, finding out a few things that are the most common complaints with what you are and making maintenance of those core values, and limiting the amount of effort you put into being generally appealing.
And this applies in general, the only working way to moderate is distributing the effort between users who are interested in the final result.
Ideally big sites would not have one single system for moderation, but multiple lists so that if two groups keep flagging each other they get separated and don't see other groups posts, instead of one group having to leave the site.
Being able to sway opinion is big business for them and they are always coming up with new ways to do it while seeming as genuine.
HN has plenty of misinformation posted on it constantly. Countless posts that are objectively wrong, and in many cases it is done intentionally. I have seen lies supporting eugenics, lies about how quantum computing is a fake conspiracy, etc etc. And yet the mods only jump in when you're impolite by referring to OP with "you" and "you're" because it is a "personal attack". They are optimizing on the wrong problem, IMO. I would rather discuss with people who are snide rather than with liars who have an agenda.
HN has its own "fake news" problems. And this is the society we are living in; you can say anything as long as it doesn't offend or hurt someone's feelings. Even if it is objectively fake horse shit.
I believe it's not moderators job to decide what is a lie and what is not, if you see a lie, write a truthful comment refuting it, that way you can convince people instead of trying to silence.
codesushi42 didn't say it was. It said the system you describe still allows lies, myths, and misinformation to spread. The only mention of moderators was in the context of chastising the poster who calls the misinformation out.
> if you see a lie, write a truthful comment refuting it, that way you can convince people instead of trying to silence
The tools you referred to are tools to silence, so you are "trying to silence" every time you flag or downvote a post. As for refuting the misinformation, I regularly see posts doing this downvoted while the misinformation is upvoted[1]. This is particularly true in discussions on contentious topics. Thus, I'm not nearly as certain as you are that these tools would protect HN from a sufficiently dedicated group.
[1] At least once, because I downvote it and the comment remains black.
Obviously we don't chastise users for correcting misinformation. We chastise them for breaking the site guidelines. How could we do otherwise?
There's an important insight here. Correcting misinformation is when it's most critical to follow the site guidelines. That's not so easy, because misinformation can be irritating and even triggering. But if you react to it with name-calling, flamewar, personal attack or things like that, then you discredit your comment and—if your position is correct—you discredit the truth. Then you're not only making HN worse, you're making the world worse.
The thing to try to remember is that while you may not owe the other commenter any better, you owe the community better, and you owe the truth better. The one who knows more has more responsibility.
https://hn.algolia.com/?dateRange=all&page=0&prefix=true&que...
My point is that people casually browsing this place are going to be infected by the misinformation and spread it to others. All while the mods overfit on whether someone's response wasn't polite enough, which in a lot of cases is biased to begin with.
Stack Exchange is a much, MUCH more reliable source of information than the horse shit I see pranced around here on a daily basis. Their moderation system actually works because it empowers knowledgeable users.
Maybe some example would help me understand what you mean. Could you link to some clear misinformation on HN that wasn't convincingly refuted elsewhere in the thread?
Look up some accounts (jlawson) and you will find they consistently post right wing BS here.
Or just search HN for eugenics and see all the crazy claims made...
Plenty other examples, but due to ignorance, like someone giving a long convincing explanation of the thermodynamics behind the efficiency of steam engines which sounded entirely convincing. But was complete utter horse shit once researched, and no one refuted it. But it was upvoted plenty.
Political opinions from across the right-left spectrum, if presented in a civil and substantive way and without fake facts, are not against the rules here. Extreme opinions tend to get downvoted pretty quickly, though.
If you outlaw this, people like me (who think inflicting stupidly and ill-health on their children by withholding these technologies is morally wrong) will just fly to Singapore. Even if you could enforce this, not every country will. 5+ standard deviation increases in many traits is on the table
Nope, 5+ std deviations is not on the table.
+5 SD change in intelligence (ie, average IQ of 175) would be amazing, but it's not obviously impossible. So it's "on the table" in the sense that cities on Mars are "on the table". It's not prohibited by any known laws of nature, and some experts are working on it.
There are lots of actual lies in circulation, so I encourage you to reserve the use of the word for things that are demonstrably false, not just ambitious claims that one might be skeptical of.
Stretching the truth like this is lying, whether you like it or not.
HN is not a crowdsourced knowledge base like stackexchange or wikipedia, to expect high percentage of accuracy on all posts, it is place of conversations and having people with different viewpoints makes it more interesting. For the thermodynamics example did you post the correct version after researching? Or maybe you found it too late when conversation have already moved on? Unfortunately that's the way all conversations work in real world too, best arguments come after it.
I am not saying that hn voting is the perfect system, but it is way better than the system where moderators check if comments are true or "right wing BS" because then instead of discussions you'd get echo chamber of everyone agreeing with moderator, and it's not guaranteed that it will be left wing echo chamber you wish for.
People are allowed to be wrong, though, and there's no rule against it. How could this be otherwise? We don't have a truth meter.
That is your reasoning, not mine.
It's not against the rules to be wrong, though. How could this be otherwise? Do you think we have a truth detector?
This smacks of the same kind of arrogant obliviousness that is insidious at Facebook and Twitter. Do you really think misinformation is not a problem there either?
You counter the problem with a reputation system that actually works. See Stack Exchange. Also with better moderation on your effort.
Maybe you should try searching HN for eugenics and see which gems you come across.
It's what you seemed to be saying with "And yet the mods only jump in when".
While I have you: you have a long history of breaking the HN guidelines by arguing in the flamewar style, directing acerbic swipes and personal insults at people, and so on. We've asked you many times to stop:
https://news.ycombinator.com/item?id=21105692
https://news.ycombinator.com/item?id=20709082
https://news.ycombinator.com/item?id=20559290
https://news.ycombinator.com/item?id=17932924
https://news.ycombinator.com/item?id=13605136
If you keep ignoring our requests instead of fixing this, we're going to ban you, just as we would any user who persisted in abusing HN this way. Other people posting bad things does not make it ok, and there's zero conflict between correcting misinformation—if that's what you're trying to do—and following the guidelines.
I would take impoliteness over toxic ideology backed by fake news any time. Listen to George Carlin much?
This whole line of thinking exemplifies why tech bros at places like Facebook and Twitter are so tone deaf to this whole problem.
You draw the line at "LMAO" but allow pro eugenics posts through?
Here's one in 2018:
Eugenics has a bad name, but it is scientifically valid. We now know that genetics play a huge role in life outcomes (e.g. adult IQ appears to be 70-80% heritable) and, for better or for worse, the eugenicists were right, even if their methods were morally wrong. We don't focus enough on positive eugenics: getting smart, non-violent and conscientious people to have large families. Right now we do the opposite: smart folks feel all sorts of pressures to have a small or no family due to careers, the expense of elite schooling, the environment, etc. The opening scene of Idiocracy nailed it.
https://news.ycombinator.com/item?id=17237184
That post is one big fucking lie. Was it flagged? Nope.
I am beginning to really loathe the hypocrisy of techies of your ilk.
On a large, open internet forum like HN, any banned user can create a new account and walk back in through the front door in 30 seconds—and many do. There will always be plenty of bad stuff getting posted. We do as much as we can, but we rely on users to flag comments and/or email us in egregious cases. As far as I can tell, you've never done either of those things, so I'm not really feeling your good faith here.
If the game is to find one shitty unflagged comment and pass it around as proof of moderator malfeasance, that's not a very interesting game. What's more interesting is that you had to go back over a year to find it. If anything, that rather suggests that your example is evidence of how little of that there is on HN, relative to other large open forums.
Meanwhile there are numerous cases of you treating others aggressively and being, frankly, an asshole on this site. You euphemize that as "impoliteness", but it's worse than mere impoliteness. It is community-poisoning. "I would take impoliteness over toxic ideology" is a non-argument—there is no good reason to have either. Using one to justify the other is bogus, and using it to justify your own mistreatment of others is cheap.
If you sincerely want to participate in the community here and do what you can to make it better—by following the guidelines, treating fellow community members respectfully, flagging egregious comments, and so on—that's great. You are welcome. But if you really don't want to do that, please don't post here. In particular, please don't take wrong comments by others—or comments that you feel are wrong—as an excuse to vent aggression.
HN has a problem with fake news. So does Facebook. And Twitter, and so forth.
Instead of saying "we can do better", you've taken the route of complete and utter denial. And in a kind of off the cuff, blame shifting way.
Just like so many other tech bros in SV. Completely unprofessional and unhinged when faced with real issues. You're enjoying the club, I guess.
Which of course suggests the obvious solution of not letting the bytes be free any longer. Make users who want to post on your site pay for it.
Why do you think that only the fanatical people would pay?
I say that with complete certainty. The vast majority of content is such crap I've never even heard of it, so I'm certainly not going to pay for it. Therefore, the only people who will pay for your content are a small group of fans (the fanatics) who both know you exist and are willing to do something about it. Calling it a drop in the bucket is grossly overestimating things.
If the content of the site isn't that good, why is it a problem if the site becomes unusable?
And remember, we're not talking about my personal content. We're talking about sites like Twitter, or HN for that matter. If you don't think the content here on HN is that good, why are you here? Would you be ok with HN becoming unusable because it gets hijacked by people who don't care about adding value to the site but just want to push their personal agendas?
Resources can be:
- time (come back tomorrow and next week to click this button and the account is yours)
- effort (captcha like, or maybe even better some time at meta-moderation: Is this a good answer?)
- monetary
In any case, if accounts are no longer free then having an account in good standing will be worth something.
Then, next time mods ban anyone it means there is a cost for them before they come back.
Why should companies be trusted to enforce elusive controls on our speech? And is it fair that tech companies act like editors and still get Section 230 liability protections as a tech platform that no editor gets?
The end result of enforcing political correctness is preference falsification, which have lots of very negative effects. This is a good video on it:
Banning people from being excessively annoying over a period of time is perhaps an option. That's after the fact, not before.
The goal of moderators (on most sites) is neither to maximize speech nor to protect people's feelings. The goal is to keep people engaged with the site, and that of necessity means balancing the people who wish to be annoying with those who will leave when their annoyance gets too high. That gets the maximum engagement, which usually goes hand in hand with maximum revenue.
Even on sites whose goal is divorced from revenue, many will find that Gresham's Law of Comments applies: bad speech drives out good. Hate speech tends to drive away people from the topic at hand, because people respond to hate speech as if it were a threat, even if it isn't immediately physical violence. Responding to that dominates the conversation, and then people interested in the original conversation leave.
Good user controls can help, but ultimately a site must keep its eye on the bottom line. You may have a hard time distinguishing hate speech from valid political speech, but users know when they're not enjoying the site, and leave. It's up to the site's designers to pick their target audience and encourage them to stay. And if that target audience is "everybody, including people who want to engage in hate speech", they may find that "nobody, except people who want to engage in hate speech" is what they end up with. Which may well be what they want, but for those who don't, they need to recognize that and take steps.
Specifically this means suppressing the alt-right, who are the most problematic causes of bad PR. Other groups - Burmese Islamophobes, for example - might get silenced too, but out of a desire to have consistent rules rather than a clear business need or a moral imperative to prevent genocide in Myanmar.
1. Effective moderation can only come from others steeped in the particular cultural context they're part of.
2. Effort should be given to moderate to give communities the ability to moderate themselves at scale.
With that in mind, it may be worth considering Reddit. Each subreddit has it's own moderation team from the community that is charged with enforcing sitewide guidelines like not doxing people, etc.
This lets them penalize and ban at the community/subreddit level instead of trying to interact with individuals.
There are problems, of course, but with 20million people a month interacting with the site you're going to have problems no matter what (as the article explains in detail).
This is because most content is self-policing by upvotes. Downvoted post dies in new so trolls know they can't reach a large audience. It's actually kind of amazing how quickly can newcomers can learn and adapt to the implicit rules and begin reinforcing it on others.
This does lead to problems when a smaller sub gets brigaded by a larger ones (or ends up on /r/all) and the original community can't outvote the outsiders.
The upvote/downvote system is fundamentally self-moderating (same thing as the comments and stories here on HN) and a light-to-medium touch by subreddit-specific moderators means that the good stuff generally rises to the top and the bad stuff generally falls to the bottom.
Is it perfect? By no means. But anecdotally, I find that I get a lot of positive and insightful content out of reddit, whereas Twitter just feels like the YouTube comment section of the world writ large.
Quora is heavily centralized - all content must be moderated by the company, there is little to no segregation of questions by dedicated community, and all questions are allowed. Individual users must be name-identified and, importantly, are the core ingredient for Quora - people come to read the content of specific people, not for quality of the content in general. Users have stake but no say in the evolution of the system, and are by design incentivised to not care about question or answer quality but instead about the people they engage with. Further, questions are considered to be "owned by everyone" - so users are free to alter questions indefinitely.
In contrast, StackExchange (not StackOverflow) has similar properties to Reddit - partitioned into smaller communities, reliant on user moderation, equipped with a somewhat reasonable appeals process that relies on a "meta" site where users can contribute to improving the site. Users have both stake and say, and importantly are dedicated to improving the average quality of answers rather than who is answering.
The difference in moderation is stark. Quora's issues with moderation have been legendary - anywhere from an inability to stop sockpuppet voting, pay-to-upvote rings, and reversing helpful edits to outright refusing to take action against documented sexual harassment by users against other users. StackExchange has had no such issues, or rather it has had vanishingly fewer issues compared to Quora.
While we obviously can't compare them on equal footing, given that the sites are so different, this is some circumstantial evidence that community moderation, allowing communities to manage their evolution, and removing the focus on individuals is a better experience between two sites that seek to accomplish the same goal.
I'm not sure what this would say about social networks - which are all about emphasis on other people - but it does seem like a great model for online communities that aren't social network focused.
Subreddits allow this to some degree, as you can create two "science" communities with different names, and have different rules held for each. It also somewhat protects against "moderator capture" - though a better job could be done allowing for more fluidity and mobility here; community moderation, trust building, isn't often the leading metric of the founders of large platforms - with Reddit creating fake users to post content to make it look like the site is busy, as one example, and I imagine they did the same once they implemented the ability to "give gold" - giving gold automatically to comments to make others adopt it faster thinking it was a new cultural norm.
A problem I've personally experienced however is moderators of subreddits ultimately have each unchecked dictatorship-censorship powers - and it's clearly a common problem of moderators being on their high horse with no potential of repercussions because Reddit as a platform doesn't moderate the moderators, at least not adequately.
Moderation should really be called parenting, parenting which is the process of role modelling and explaining - to help people or children grow by deepening their understanding by guiding them to appropriate resources to help them understand different concepts, when necessary.
Or, you know, individual websites with forums that aren't tied into a giant superstructure and therefore is a constant target of efforts in manipulation and social engineering both from its owners and from third parties.
Just today, for example, it was revealed that Facebook is no longer going to prohibit false factual claims in paid political advertisements -- even if those falsehoods are determined by generally-respected fact checkers. See, e.g., https://popular.info/p/facebook-says-trump-can-lie-in-his (and associated commentary https://news.ycombinator.com/item?id=21152869).
Factcheck.org claims: "there is no evidence that Hunter Biden was ever under investigation or that his father pressured Ukraine to fire Shokin on his behalf."
However, the fired Ukranian prosecutor testified in court that "the truth is that I was forced out because I was leading a wide-ranging corruption probe into Burisma Holdings, a natural gas firm active in Ukraine and Joe Biden’s son, Hunter Biden, was a member of the Board of Directors." [1]
Testimony taken under penalty of perjury is evidence, and factcheck.org was wrong to claim that there is no evidence.
[1] https://thehill.com/opinion/campaign/463307-solomon-these-on...
Moreover, let's not confuse testimonial evidence with fact. They are not identical. In our judicial system, the jury is the finder of fact; they weigh the evidence to make conclusions.
We also can't let a minor technical error in a tangential report invalidate the rest of what otherwise is a lie -- specifically the primary bold claim in the example advertisement that's at the heart of the article.
I think the biggest issue with social media is: do not make truth a popularity contest
https://youtu.be/Q0_AqpdwqK4?t=51m49s
edit: phone brain skipped over the "on his behalf" part of the sentence, I thought that they'd said there was no evidence Biden even pressured the government to fire Shokin.
"I said, I’m telling you, you’re not getting the billion dollars. I said, you’re not getting the billion. I’m going to be leaving here in, I think it was about six hours. I looked at them and said: I’m leaving in six hours. If the prosecutor is not fired, you’re not getting the money. Well, son of a bitch. (Laughter.) He got fired. And they put in place someone who was solid at the time."
Surely those of us who participate on HN and code for a living can appreciate the logical difference:
if (prosector_employed) {
ukraine_bank_bal += 0;
} else {
if (other_conditions) {
ukraine_bank_bal += 1_000_000_000_000;
}
}Fact 1: Burisma was under investigation.
Fact 2: Hunter Biden was on Burisma’s board.
Fact 3: Hunter Biden himself was not under investigation. Not only that, there is no evidence that the investigation Burisma was under had any relevance to Hunter Biden.
edit: downvoters better explain themselves. If you have evidence to the contrary, let’s see it.
E.g. The system of users you're part of - who their "leader" is or who is at the lead - acts as a filter setting creating a safe space of users, community, that will be, is being moderated in a way that aligns with you - that you agree with; do you want to be in a good, healthy parental environment or a bad parenting environment?
There could also be a Board of Directors or Advisory layer - so perhaps known people who take a stand for freedom of speech like Jordan Peterson would be on advisory boards, or even perhaps taking a lead role himself if he cared to take on that role - whatever that ends up entailing.
What, I think, can be done:
1. Don't just hire expensive PhDs and hope that algorithms can correctly classify racism, etc. Hire an expensive product visionary who can build holistic approach to address moderation problem and knows what is solvable with ML and what needs pivoting to human-guided resolution.
2. Don't hire lots of cheap annotators in "Rural Inida" but hire or train fewer expensive experts and give them powerful tools that can scale their work to handle efficiently all suspicious traffic.
3. Give power to "normal" users to flag inappropriate content or behavior and loop this in a thought-out workflow with your ML and your experts on the other end.
4. Partition users and content so that bad actors and bad content get clustered away and are less easily accessible for others.
Why bigtech companies don't do it? Besides fallacy of thinking this is a "typical" ML problem, moderation is hard. It's also hard to make a business case for short-minded bosses and prove revenue increase or expenses cut. Lastly, some bigtech ones benefit a lot from abuse so they can't change immediately to stop it all.
For example, the community following and viewing youtube gun-shooting videos would say none of it need to be deleted or demonetised, whereas youtube themselves prefers to often demonetise such videos.
In Albert Hirschman’s typology it’s all exit, voice and loyalty are irrelevant.
Moderating open venues with no sense of commonality or community where anyone can just show up and say anything is ... much less feasible.
1. Moderation doesn't scale. It can't be automated with an algorithm (well), it can't be done well by a bunch of low paid contractors with a handbook and it can't be done across a million user platform by about three people.
Sites like Twitter, Facebook, YouTube etc tried to get round this by using the above algorithms and contractors, and that's partly why they're so terrible at it.
2. Moderation is community specific, with each community having different standards for what's acceptable. For instance, a site like 4chan or 8chan may find nearly anything acceptable, whereas the official Disney or Lego site might only want stuff that's appropriate for a young audience.
That's why forums work so well, because the userbase and owners decide what's acceptable there, and those outside of said grouo can join/not join based on their preferences. Same with Reddit to some degree, though that is complicated by people being able to move between subreddits so easily and them being hosted in the same place.
Unfortunately, many of these larges don't have this. They have one free for all open space where hundreds of different communities are forced to interact with each other. They stick millions of people into a newsfeed/search/whatever that despise each other's views, have completely ideas about what's acceptable and hate every ounce of the other side.
That's a recipe for disaster. Putting those who fundamentally hate each other in the same area for hours per day leads to a toxic atmosphere, and creates a situation that's almost impossible to police well. It's why school and prison are so bad; the kids and prisoners just have too many fundamentally different, conflicting worldviews to get along.
The only way to fix this is to:
1. Accept that ommunities should be moderated by their members, not robots or contractors.
2. Split the community into smaller ones where people can set their own boundaries for acceptable behaviour.
3. Try and stop intercommunity trolling as best as possible
Filtering out opinions the majority doesn't want to pay to hear is simpler and more lucrative anyway.
From the spectrum of Math -> Physics -> Chemistry -> Biology -> Psychology, where do you draw the line? This isn't an easy question.
That is really really good. Yet, take that 0.1% to scale. In America alone that would mean that you have 330,000 people that think the Earth is flat. On Facebook scale (2.5 billion monthly average users) that'd be all the way up to 2.5 million people. And thanks to the internet people with 'eccentric' views are more capable than ever of joining up with other people with such views. And people with these views tend to be very strongly inclined to do just that, alongside also trying to evangelize their views so much as they can - because they think they know something other people do not.
This effect creates a deeply misleading image of the relative popularity of various views and values. Can you imagine a Facebook group with millions of people who genuinely think the Earth is flat, and many people popping their head up in various locations to advocate for such a view? You could have that, yet it be the case that 99.9% of people do not feel that way.
Scale is a hell of a thing. And given the increasing size of various platforms, you're always going to see what you perceive to be large numbers of people with rather peculiar views and values. It in no way suggests there are actually large numbers of people with these views and values. The social media paradox stands head and shoulders above that relatively petty birthday paradox.
Why do we want a world where platforms protect videos promoting and glorifying beheadings, exactly?
To play devil's advocate, "objectively" these beheadings are still happening somewhere in the world. It's an undeniable truth even though you don't want to see the evidence for it. For a lot of people this is their flat earth. No evidence means it's not happening.
Why not allow the content to be seen, let the world be horrified that there are people driven to become like this, and try to understand what led them to do those things?
At the time, conservative media outlets seemed predominantly critical that American platforms weren't censoring enough content. Even if that content wasn't actually illegal to publish under US law.
Here's a 2014 article from the conservative site WorldNetDaily, for example:
"ISIS-branded merchandise sold on Amazon, Facebook"
https://www.wnd.com/2014/09/isis-branded-merchandise-sold-on...
Quotes from the article:
Dave Gaubatz, author of “Muslim Mafia: Inside the Secret Underworld That’s Conspiring to Islamize America,” contends Facebook and other social media sites have a responsibility to shut down the forums used to market radical Islam and mobilize Islamic youth.
“I am a defender of the U.S. Constitution but the Constitution was not designed for enemies of America,” said Gaubatz, a former U.S. Air Force investigator.
“We must stop jihad online because these groups target our children through social media,” he told Fox News.
...
“ISIS is more than likely not producing shirts but indirectly they are benefiting from it,” Scotty Neil, a former Green Beret who founded Operator, a clothing company geared toward special ops soldiers, told Fox News. “I don’t think that T-shirt company X is sending the Islamic State funds, but people wearing these shirts are making an outward statement and that often starts a dialogue and debate that furthers their message.”
Reporter: "What do you think of foreign affairs?" West: "I'm all for 'em!"
"Is that a gun in your pocket or are you just happy to see me?"
Language is infinitely malleable. Algorithms don't stand a chance.
I mentioned this before but my GF worked on an mmo's for tweens. Said one experiment with filters ended with a 12 year old boy writing, I'm going to stick my giraffe up your pink bunny.
That's how figure-eight makes its money
https://cacm.acm.org/magazines/2013/8/166313-software-aims-t...
That's exactly what the article says: "you’d write up some guidelines (...) and then contract with some external company to have human beings read those guidelines and rate lots of examples that you send them" and then it mentions people from places with low salaries, like rural India and the Philippines.
And then in the possible solutions, it mentions hiring people well steeped into the specific cultural context of those you're trying to moderate.
This is where I think the article undermines itself, because if paying for some different (and probably more expensive) set of people may be a solution, then the question that was supposed to be answered remains: "why do companies with unbounded resources not do that?"
If we hadn't invented free, we'd have moderation because being repeatedly abusive and troll live for money, is in the end self defeating.
If you want moderation enough, get rid of free.
Maybe the optimism people had of the internet being an all inclusive community was ill fated.
Exclusivity is may be the next fad, driven by the trolling of few in an open community.
Does anybody really expect automated moderation to work even remotely decent?
With twitter and its shouty kin, splitting the userbase into "normies" and "broadcaster" (the top 10% with the most views/reach)
Broadcasters have a disproportionate effect in terms of reach and tone. Spending time (and people) closely moderating in a very visible and transparent way will set the tone for everyone.
Twitter is hamstrung because it's most famous user (Trump) breaks its guidelines monthly (I mean he literally threatened to bomb iran, if thats not violent and intimidating behaviour I don't know what is)
Also, controversy drives engagement, which drives revenue. So I would say that its a feature of twitter, not a bug.
When people talk about keeping violence off social networks, they mean keeping personal violent threats off social networks. Whether to make war or peace is a political question, one that's perfectly fair to discuss in public. You don't get to impose pacifist foreign policy on the president by conflating random threats of personal violence with the legitimate business of statecraft.
Threatening to bomb a country is threatening violence, this is against the terms of service: https://help.twitter.com/en/rules-and-policies/twitter-rules to quote:
> you may not threaten violence against an individual or a group of people
Like the law, it either applies equally to everyone, or its does not apply.
> You don't get to impose pacifist foreign policy on the president by conflating random threats of personal violence with the legitimate business of statecraft.
Again, you are reading way more into this. Either the Terms of service apply to everyone, or they do not apply.
According to those terms of service, there is no different between me threatening to kill a group of people, and trump doing the same.
As I said, transparency and consistency is the only way it can be implemented effectively.
If a site's terms of service prohibit endorsing legitimate acts of the state, that TOS is a political statement.
yes, it can be.
> It's no more an endorsement of "violence"
War _is_ violence.
> conflating legitimate acts of the state with extralegal personal criminality
Well, you're saying that I equate the president's tweets as his personal threats. That's orthogonal to extralegal. It is also irrelevant, for the reasons I'm about to lay out:
The Terms of Service are the basis of a contract for using the site[1]. Unless there is a specific clause for "legitimate acts of state" then its a binary choice. Choosing not to implement them equally is a political choice.
look, its perfectly possibly to not agree with a person, but insist that legal/procedural process is adhered to. The president is a person like any other, and subject to the same legal/procedural process as the rest of us.
[1] well usually.
You're wading into deep waters here. What makes a state's actions "legitimate"? There are a lot of theories on this.
One of these theories says that a state's legitimacy and sovereignty rests in the will of the people it governs. For example, the U.S declaration of independence states in it's first paragraph "Governments ... deriv[e] their just powers from the consent of the governed". Accordingly, if a state does a thing, and enough people ruled under that state believe it's illegitimate, then it is indeed illegitimate.
Under this principle, criticizing the actions of those that govern you is not unpatriotic or "a political statement" as you say, it's an integral part of government itself.
Case in point - youtube. They changed their demonitization algo in response to complaints and now they have complaints from other users that the algo is producing false positives. For example, the "Great War" history podcast had 100s of youtube videos demonitized because they talk about storm troopers and Nazis, which of course isn't great if you are a Nazi, but maybe ok if you're a history podcast.
The issue is that each video generates on an individual level so little money for youtube that it just doesn't pay to have an individual go through each and every video on their platform and make a value judgement on worth. I mean anyone can upload a video for free and each watch of a video is maybe at maximum a few cents from an advertiser in profit to youtube.
Facebook and all other content aggregation web forums face the same conundrum. And the problem doesn't get better if we invent new algos or people more efficiently (somehow). On the one hand you now have an algo that determines what can be said or not said en masse and is making the decisions in an increasingly black box (as the heuristics will be by necessity rather complicated), on the other you have the very poor filtering videos or at the very least fallible human judgement still at the wheel on what gets to be said and not said.
Who watches the watchers? At the moment we have a handful of powerful media conglomerates that effectively control through monopsony almost all the social media on the internet. What, we've got Alibaba, Facebook, youtube, reddit, and instagram - that covers at a rough guess like 60-70% of social media traffic? But these are companies that are only successful at scale - you go on a social media platform because all your friends are on it (a la the myspace model) and you are given a "free" user experience because aggregating millions of people allows for a few cents in ad revenue per user to subsidize the servers at scale.
This problem is probably baked into the cake of this particular pattern and isn't fixable. Boy is it going to be wild when we finally crack how to make deep fake videos!
Also, name ONE company with INFINITE resources.