The young people sifting through the internet's worst horrors
ft.com
ft.com
This is the exact type of content that I think AI is so crucial for detecting, and it's a bit sad that we often hear so about all the bad things you can generate with AI and so little about all the good. If we need to train models on this type of content to make it easier to detect and remove, to prevent mentally scarring people, then personally I'm all for it -- regardless of the "it can also generate that bad content" cost.
Probably don't say this in front of actual veterans.
>actual
Probably don't say this
i served cod:b0 - mw3
now give me my wendys discount please
This is referring to the "GenX" who watched this out of his own free will, which is also not comparable to what the people in this article have to deal with.
On the other hand many people, if I had to guess I'd say the vast majority, have not seen any of that stuff on the internet. I have, but because I actively went looking for it. Likewise if I ask around amongst friends the only ones who saw the real gore all admitted having actively searched for it. In other words: even before we saw it there might have been something different in our world view already.
That's sort of the point though: we do that, but whereas around y2k forums were the online communities, I don't exactly have the impression that is still the case. And it's not like you're going to see much NSFL content on, say, TikTok.
It still sure is a wild west in many places.
Agreed. I was brought up in a troubled home and spent a lot (if not all) of my childhood/early teens on 4chans /b/ board as a result (mid-late 2000s, early 10s). Looking back at it, it seems like it was THE place that brought together all the damaged individuals.
The stuff I've seen there desensitized me to a basically every disgusting/horrid/tragic thing I had to witness later on in life, other than losses of loved ones in of themselves.
One of them is a paramedic now. I imagine, surgeons might go through similar character development.
pretty much sums it up; anything that does not break you, will make you stronger.
ever chewed on your food, breathing thru the nose, while cleaning diarrhea diapers and being screamed at? your parents did.
Sometimes memories are great merely for the fact that they're the past ;)
Not even remotely true. Plenty of people have to spend years in therapy to undo their parent's trauma.
Let's put it another way, do you think a rape victim in college will have better outcomes than someone who is not raped in college?
I think in your cases it "broke" them
Of course things either break you or make you stronger. The unexpected outcome would be for to leave you exactly the way you were before.
It's a positive dismissal.
It makes people weaker.
not sure about the rape analogy thou
It is reflective of a society that sees emotions that don't feel productive as "bad" and to make excuses or falsely positive reasons to dismiss them.
The classic example is the British attitude of the "stiff upper lip".
These narratives result in lower happiness, compassion and generally poorer mental health.
Don't let a society that encoded outdated views on emotional health dictate that you shouldn't freely allow emotions to complete their cycle and be expressed.
I truly cant express how bad perpetuating this kind of thinking is on an individual and societal level.
The best counterexample is freezing damage. Each time makes you weaker.
I believe both e.g. participating in war or being a victim of a crime makes you mentally weaker.
Many veterans seems to be the brink of collapse and those people were probably better suited mentally than the average man for ensuring war since they self selected for it? Or maybe less naive people would fare better?
then again it can hardly be denied that a reoccurrence is seldomly an equally devastating experience
Doesn't fit any definition of a sociopath I looked up, quite contrary
Sending goatse over IRC was a rite of passage back when I was in middle school. Kirk Johnson's service to humanity is invaluable.
It's funny how often we get asked "what's the worst call you've ever been on?" which, when you think about it, is a strange question to ask. Do you go around to other people in your life on social occasions to ask them to relive unpleasant events for your curiosity?
However, that being said:
It's generally assumed that it's the most gruesome call. The most unpleasant trauma. That's not the case. When it comes down to it, we're all just tissue and blood. We stop bleeding, put (some) things back where they belong, and try to replace what has been lost (fluids), etc.
The worst calls are generally the tragic, the emotional abuse. Child sexual assault. Elder neglect. The horrible accidents that are no-one's fault, but will rack someone with guilt for the rest of their lives.
Those ones add up. I'd say those are the reasons for most EMS and Fire PTSD.
There's a good documentary about the rebirth of Detroit, which was for a long time the number one city for arson in the world, called "Burn" (incidentally financed/championed by Denis Leary)...
One of the firefighters in that documentary says, sitting, emotionally exhausted and eyes shallow from a long night, or career:
> I wish my head could forget what my eyes have seen.
Reading it makes me wonder why anyone would ever want to be a police officer. God knows it isn't the pay.
unsure how much of it is curiosity or whatever psychological conditions the rest of comments were suggesting. regardless, i would not consider it an ideal approach to build your stomach for the medical field.
This could be a reasonable business for a company in the countries where it is not illegal to moderate content like that.
However, There can never exist a tool that can correctly detect harmful content. You would need the intent of a submission to get to that level of accuracy.
Everything else is: AI filters -> Human review.
Your offenders are 2 types: Bad actors and Adversaries. Both evolve to find ways around your detection processes.
Detection and obfuscation are linked.
Thou we have to be careful not to outlaw content or viewpoints else our collective ability to cope will diminish.
What has changed over the years is - the cost to spam the entire world with zillion messages a second is tending to ZERO.
While this is an achievement it's also a disaster cause it's akin to everyone having an almost free high power broadcast transmitter sitting on their roof.
We regulate and auction radio spectrum and don't allow everyone on the planet to broadcast simultaneously on what ever frequency they want. Cause the noise would make signal drop to 0. But on the internet it's allowed and it's almost free.
At this volume, nobody could possibly win. Social networks need to break down quite a bit to get something manageable.
One solution to that is whitelisting. But we don't want 3rd party censorship, so a federated system where we rate sources and content ourselves seems like a good idea. Unfortunately kids won't filter anything - they are drawn to the unusual and forbidden.
If you add an extra checkmark people have to get to be able to post then hackers will just target those people.
Facebook and Instagram used to work like that. It only showed you stuff you choose to want to see from those you followed.
But there is more money in forcing stuff on people I guess. Hence the algorithms.
And look, I get that we are talking about children as the viewers, not you... but children simply shouldn't be on the Internet browsing random stuff in the first place!! The whitelist can then be all encompassing, as it should be their parents showing them stuff.
https://weblog.masukomi.org/2018/03/25/zed-shaws-utu-saving-...
Basically baking in a reputation system into network protocols, to deter bad actors… not sure how viable a solution it is, just fun to think how far back people were thinking about solutions to these problems.
I’m not a religious man, but I think I’m becoming one. Mostly because I feel the appearance of all this stuff correlates with the decline of religion. I only knew which one to choose that didn’t have as much behind it as the Internet does I would, for surely be a devout follower.
We've already had both things happen in recent times, and it's been a legal and PR nightmare for affected companies. So while using AI would be great to avoid harm to any human moderators, the system would have to be perfect (or nearly perfect) in order to avoid any side effects that would cause serious harm to innocent people and the company/platform in question.
I disagree with that part of the statement.
Companies would just defer to the AI rather than human choices and say "Well, computer says no"
What is the source for this seemingly widely held belief?
Bad images on a screen aren’t inherently harmful to many people.
I grew up (10+ hours a day for a decade) on the edgy, uncensored internet, and I don’t think it broke me or harmed me in any way.
I'd say "I don't go home with guys like that any more", but I was never quite naïve enough to go home with guys like that in the first place.
Can we say the same about bad images on a screen?
All of this “if you look at enough of them you become broken” seems like folk “wisdom” to me. I don’t want to be the guy holding up the “[citation needed]” sign, but I am truly skeptical of this claim.
Just because it’s gross and unpleasant to look at doesn’t mean that lots of exposure causes permanent damage.
I was in a Chatroulette one day that did a number on me. 10 seconds, mostly for me and my neighbor to parse what we were seeing. Once we did we immediately exited and shut the laptop and just sat there, completely mindfucked at what we saw. This was maybe like 2010 and I still think about it, it was horrid. If I was subjected to content like that for 40 hours a week I’d either be an alcoholic or checking myself into the psych ward.
How do we know that most people would respond that way?
It seems like a major unexamined assumption to me. I don’t know why everyone just takes this as truth on faith.
OTOH, if you're getting emotionally abused in a place that's already full of damaged people (and if you're seeing all of their pathological coping strategies first hand), that has more potential for long term harm
However, you got used to cheap thrills coming from stories about “horrors out there” (whether digitally far away in some “darknet”, or geographically, in some “third world country”), and your imagination has already drawn you a picture of countless maniacs recreating slasher movie scenes (“life imitates art”?). It is simply logistically impossible to create that much, not to mention that criminals are not in a hurry to film themselves.
As for “shootings” (an American term for media spectacle in which murders are just seeds), many of those have been causally televised for entertainment purposes. I recall some high profile “shooting” even involved some president showing an example of how all good citizens should consume that content in front of TV screens.
The 'edgy, uncensored' internet you know about isn't even close to what paramedics and people in the OP experience. I know people that did the same thing, they grew up on that side of the internet. One of them became a paramedic and had to quit after a few years because it was starting to severely break them.
But by all means, if you're the kinda person to go 'Nah, I wouldn't break' then you should give these jobs a shot. See how far you get.
Your denial is a telltale sign of PTSD.
Not sure if you ever been a child, but kids will be searching for porn and violence on their own
Most places do not have "time limits".
I find no evidence of abattoir workers becoming more likely to be serial killers.
People used to kill their own animals and weren't vegetarians.
> Most places do not have "time limits".
I couldn't find anything about slaughterhouses having lifelong limits for employees and would love a link or search term to use because it's an interesting concept to me.
> I find no evidence of abattoir workers becoming more likely to be serial killers.
I also could not find evidence for this. Here is a meta analysis of many studies, none of which mention slaughterhouse workers being more likely to be serial killers. Some studies show higher crime rates in towns with slaughterhouses, but not for violent crimes. https://www.ncbi.nlm.nih.gov/pmc/articles/PMC10009492/
> People used to kill their own animals and weren't vegetarians.
This is trivially true?
That's not "gore".
Animal gore is not subsistence living. It's, with apologies for the graphicness, videos of people catching cats in cages and dousing them in gasoline in the cage and ...
Generative AI and detection/classification are very different. The bad news of the last few months are almost exclusively about generative AI. Your good example is a detection AI.
>This is the exact type of content that I think AI is so crucial for detecting, and it's a bit sad that we often hear so about all the bad things you can generate with AI and so little about all the good
most companies care about making money, so there's a lot more focus on how it can streamline the workflow/replace labor. Not as much business on how to use it as an auto-moderator.
At the end of the day, we evolved to endure much worse than sitting at a computer and watching stuff happen, and our ancestors have.
If anything, being too coddled and sheltered is a way to produce way more harm. Even being raped is more traumatic when you're socially trained to expect to be traumatized.
Fortunately, compared to what the people in the article deal with, it was relatively tame. But it still took its mental toll - having to look at dick pics all day is not healthy.
worse, he has to look at actual diseased dicks all day.
not enough eye bleach in kiev
Would looking at human hands all day "take its mental toll"? Probably because it would be as boring as watching paint dry, and doing that day in day out is not good for one's sanity.
I think the Anglosphere's over-sexulisation of any and all nudity makes it worse than it needs to be (I think my exposure to e.g. Germany's sauna culture on a few trips has really helped me form a healither attitudes to nudity in a dozen or two hours than the rest of my life over here, and that kind of thing being more common would probably help people be able to more easily shake it off) but I think the tramatic part is the stalker behaviour and being directly targeted by someone with a lewd motive. And it being done when the person sending it knows it's undesired and forcing them to look is kind of almost rapey.
So for me, I'd find it creepy if somebody was targeting me with that, but would have zero issues approaching it from "I'm here to filter out the dick picks so I'm going to see a lot of anatomy". This is very different to e.g. gore where I actualy do feel a bit physically sick if I know it's real, but if I randomly see nudity that's not motivated at me it's basically nothing.
Completely? Yeah, I don't see it. Maybe because I'm German and there's very little fuss made about nudity over here*, which in turn makes me very confident it's just a cultural thing. Society taught you that there's something special about genitals, so you start believing it. Most people can probably overcome this through simple exposure or doctors would have a problem.
What's going to matter more is the setting. I'm guessing the pictures are supposed to be sexual, which might affect viewers more than the fact it's a picture of a penis.
> There are many women who are traumatized by getting sent dick photos.
I'm sorry, but if seeing a penis can traumatize someone, there's something wrong with them - and it's not the fact they've been sent a dick pic. It doesn't excuse others being intrusive or exploiting that vulnerability, but it's still a vulnerability that is way abnormal and should probably be addressed.
Overall I agree with you that it can affect someone, but I'd do so with more nuance than using words like "trauma".
*There's way more "extreme" examples than Germans, even ignoring our animal relatives.
USA and UK are just exceptionally prudish (by Western standards at least).
A urologist can look at penises all day and not care because there's no ill intent behind the display. On a dating site that's absolutely not the case.
Why? I mean, if you are just looking at nudity - even if the men are 'prepared for sex' - at the end of the day, it is just nudity. I've worked in nursing homes. Other folks work at hospitals. Lots of folks see nudity everyday. Lots of those folks see genitals daily, in a much more intimate way than a dick pic.
I don't really get what is so unhealthy about it. There is nothing inherently wrong with simple nudity in general, even when it is suggestive.
Finally, you curtail your argument by saying “simple nudity”. Trust and Safety exists because of context and action. These arent tasteful nudes or art people are looking at.
I wont speculate too much, but the intent of a picture, the context and the target make a difference. Sending a pic to someone not interested in them, or a minor - has a vastly different connotation.
Heck, it isn't even universally linked to sex. I don't have a penis, but from what I understand, they do randomly become erect and cycle through this stage during sleep.
A penis, even in hand and suggestive, is still simple nudity. None of the people in the center have had it sent to them personally, and surely they know.
Harassment using pictures of yourself is different: That's harassment, and should be frowned upon. They are still using simple nudity to do it, and the nudity isn't the issue.
That being said, if it was a picture of a penis erect in sleep, the context of "probably not consensualy taken" on itself makes it more disturbing. And seeing a lot of these can easily make you more paranoid to sleep where you can't lock door and everything.
Spending time defining only the non problem parts is a luxury. Theres pages of que to clean and no one to do it. I need a definition, plus examples and tests that a team can actually use daily.
Furthermore - unsolicited sexual imagery IS traumatic to a swathe of people (survivors of abuse) and illegal in many cultures.
That moderators get affected seeing such content should not be a surprise. The very least that happens to mods is desensitization. Paranoia, PTSD, high risk behaviors are common fates if you work in tough ques.
In the context of a dating site, sending someone a picture of a steak is inappropriate and creepy. Is the user trying to communicate that they see someone as a piece of meat to be used for pleasure? Is it a threat ("I'm going to cut you up")?
Likewise, there's nothing inherently wrong with a picture of a penis. But seeing first hand the aggression and intent to humiliate or victimize that's behind a dick pic is what's disturbing. See enough of that every day and you'd lose your faith in men. That's the problem for the moderators.
If you had to view that harassment secondhand every single day, wouldn't you feel a little disgusted after a while?
Sure, you can look at it and say "this isn't about me", but does that make the disgust go away?
I think a big part of it is adequate training; Think of surgery, a trained surgeon seems to be able to cut someone open (to help obviously) and go to bed fine that night but if I ever had to do it, regardless of the outcome I most likely wouldn't be able to sleep.
An adequately trained content moderator should be equipped with whatever emotional tools needed before they're expected to moderate their company's content safely.
To expand a bit. One of the reasons why it could be seen as unhealthy.
You are moderating profile pics. These are picture that will be shown publicly on someone’s profile.
What you receive are a large number of dick pics.
You reject the pics explaining why they are inappropriate and just receive more.
What do you start to think about men in general?
at the same level as watching paint dry all day.
Costco has shown repeatedly that it is possible to build a good business, while treating employees/suppliers etc decently. If Costco can do it in retail business (where the margins aren't as lucrative as software business), why can't Meta?
It feels as though they go out of their way to be as nasty as possible. Or live in some kind of weird bubble - like this arsehole for example https://www.businessinsider.com/panera-founder-workers-not-m...
"So much of what running a business is about is figuring out 'how do I connect with people?'" Shaich told BI. "What motivates them, and how do I help them decide to affiliate with what the mission of the enterprise is?" He said therapy is about better understanding ourselves, where we come from, and our own motivations. In turn, that can build our ability to form alliances and find commonalities with other people. "And that makes you a much more powerful manager," Shaich said. "Every one of us brings our own humanity to it. Similarly, I think it makes us more empathetic if we start by being empathetic to ourselves and learning and thinking about ourselves. We're able to be more empathetic, not just to our team members and the people we work with, but also to our customers."
...sounds like a total arsehole to me!
Apparently, CEOs are disproportionately likely to be sociopaths (with some psychopathic tendencies as well). I've heard numbers from 15-25%.
>Or live in some kind of weird bubble - like this arsehole for example
The Panera founder? He seems to understand his place pretty well. May be in a bubble (a bit too idealist of what he hopes for from what are just entry level workers, likely with no growth prospects) , but I can't really call him an ass for attempting to understand. Most others just don't seem to GAF.
I say that because I have yet to reconcile how any good person could step up to run a business in a world where the sociopaths almost always win.
Good people cannot fake being evil, but evil can fake being good. Consequently, good people have an inherent disadvantage that will lose in the marketplace when faced with evil adversaries.
The problem is our system is set up to reward people with this mental disorder. It's like a machine that pushes these people to the top.
You could say that in order to become a C-level, you have to act like a sociopath.
Let's change the system.
Not-being-a-sociopath is a USP itself: users/customers of a product/service/system/platform that resists _enshitification_ will likely stay loyal, especially when the service offered relies on network-effects; I read this why Craigslist is still around, for example; similarly, Apple's tight control over their own platform (for better and for worse) keeps people (like myself) attached to iOS, after-all, the iOS home-screen doesn't show you ads for CandyCrush or Evernote when you get a brand new phone, but Windows 10 does - so both Apple and Craigslist are examples of when not-being-sociopathic results in a solid business, faithful customers, and a decent public reputation.
Of course, this doesn't apply when the bad eggs are able to simply buy-out any civic-minded competition (e.g. if Craigslist was publicly traded, they'd have been acquired by a major legacy publisher by now).
On a related note, I don't suppose you've heard of "B Corporation"? https://www.bcorporation.net - apparently companies are now advertising that they're not optimizing for shareholder value - it's something I've seen an increasing amount over the past year - though I'm not-yet-convinced it isn't something like a greenwashing campaign or a fig-leaf like BBB. We shall see...
Edit: A summary quote for those not wanting to read the rather lengthy and thorough essay:
"Instead of recognizing that for-profit corporations will seek profit for their stockholders using all legal means available, we imbue these corporations with a personality and assume they are moral beings capable of being “better” in the long-run than the lowest common denominator. We act as if entities in which only capital has a vote will somehow be able to deny the stockholders their desires, when a choice has to be made between profit for those who control the board’s reelection prospects and positive outcomes for the employees and communities who do not."
https://www.wakeforestlawreview.com/2012/04/our-continuing-s...
What you’ll actually find is that executives are expected to act with the best interests of the company in mind but are given broad discretion for what that means. This is because there’s no way to reliably predict the future and any non-trivial business decision requires a gamble on multiple conditions and the outcome is hard to judge over a non-trivial timeframe. You can replace an executive if you’re unhappy, but there’s no way you’re getting any money back unless you can show something like fraud or gross nepotism.
As a simple example, during the 90s and early 2000s some analysts said Apple should switch to Windows or license macOS to PC manufacturers. At the time, they had a fair argument that this would boost profits and if your fictitious law really existed, Jobs might not have been able to ignore them – and shareholders would have missed out on many billions in value which was created later. If you measured his performance over a single year, you’d have been disastrously wrong over a decade.
"By so stating, I do not mean to imply that the corporate law requires directors to maximize short-term profits for stockholders. Rather, I simply indicate that the corporate law requires directors, as a matter of their duty of loyalty, to pursue a good faith strategy to maximize profits for the stockholders. The directors, of course, retain substantial discretion, outside the context of a change of control, to decide how best to achieve that goal and the appropriate time frame for delivering those returns."
In Finnish law I'm more familiar with it's very clear: "The purpose of a company is to make profit for its stockholders, unless otherwise prescribed in the company bylaws." (my translation)
My claim is that the idea that for-profits somehow have some benevolent interests is the main lie that keeps the populace from demanding more control over the corporations.
Yes, there's a lot of leeway for HOW to maximize the profit and on what timescale, but the purpose still has to be profit maximization. For example a court ruled against Henry Ford rising workers' wages for the benefit of the workers and the society.
I don't really understand why people struggle with this IMHO plain fact that for-profit is for-profit. Maybe it challenges the idea that "free market" will benefit us all?
https://www.wakeforestlawreview.com/2012/04/our-continuing-s...
I can't answer the first, but AFAICT the latter is just an evolutionary pressure of a sort: as more ruthless cultures are selected for, the successful individuals in those cultures become those who embody ruthlessness all the time instead of people who adjust their level of compassion up or down as the situation dictates.
In a very competitive situation where those expenses hurt competitiveness, eventually that can result in the authority figure/organization losing the competition - which removes that authority figure from authority (or destroys the entire organization) and hence the benefits to the manipulator.
Having an authority figure who is always ruthless and selfish doesn’t have that failure mode.
The failure mode in that situation is one where the authority figure is inappropriately ruthless and selfish to the point it is harming their effectiveness/destroying the organization. However, the system is able to handle that better - as long as the authority figure follows the codified rules and delivers results, that’s ’business as usual’, and if they don’t, there are penalties - up to removing the authority figure or ruining them. It tends to be more obvious than excess manipulators, as by their nature assholes leave more obvious marks.
And the authority figures selfishness here helps prevent them from doing anything to that extent that can be documented.
In a brutal environment, a consistently ruthless and selfish authority figure (as long as they are effective in their goals) can be the easier and more stable option.
Near as I can tell, it’s why ‘dark triad’ traits are evolutionarily advantageous in the right mix.
Too much of them destroys what is needed to actually produce value and grow. Too little makes one susceptible to predators.
Until we see a culture shift corporate leadership, these type of people are going to continue to be rewarded and go on mentor the next generation to do the same.
I get that these human agents are most likely providing labelled training data as opposed to actual filtering but still, surely on more edge-case footage where the model is not confident: not things that could very easily and confidently be classified as inappropriate.
A quick Google tells me about 1% of the population are psychopaths. There are 80 million people on the planet that have no empathy or conscience. And that's just one angle we could look at this from. The point is, there's a truckload of fucked up shit on the net and AI isn't that good yet.
I would beg to differ. AI is definitely good enough to identify fucked up things. Feed GPT-4 even a subtly fcked up question, or fcked up image and it'll be onto you immediately
When I said edge cases, I wasn't arguing that there wouldn't be any edge cases - I'm saying the human agents were being shown videos that were not edge cases - i.e sexual abuse, gore - if it's bad enough to traumatize a human being, it's also high signal enough for a model to pick it up.
Yes, human agents should be used for labelling ACTUAL edge cases where a model might be confused - i.e is this a nerf gun fight or a real gun fight, is this person nude or is it just their shirt... not a plain beheading video.
(I'm not as optimistic about the sparseness of beheading videos, though)
I think you have just described evil.
The "evil" category often makes people think that the "evil" entities have some motives and logic of operation that "good" people just can't understand or relate to at all.
There was a sort of internally coherent logic and motivation for Nazi death camps (and to many similar horrors). I don't agree with it at all and I find the results of it extremely harmful and such logic must be vigorously resisted. And to vigorously resist it, it has to be understood.
However, I'm not at all sure that I would have resisted the death camps if I were to formulate my views in the same situation as Nazi germans were. I could well be a Putinist in current Russia. And I probably wouldn't think I was evil.
Corporations are made of humans, who, it’s been shown, care about other humans a lot of the time. I think the more we rely on these power structures for our own self preservation, the more we start to weaponize them against weaker forms (normal people) as a form of active defense.
I like the reference to Cthulhu, it really is like a higher order life form. Workers are the cells, infrastructure the body, and the c-suite is of course the ravenous mind. You as a human don’t care what happens to a cell in a Petri dish, the same way corporations don’t care about what happens to individual people. As a human, I find this evil, and wonder if there are perhaps other higher order life forms (economic systems) we can construct that aren’t as harmful to their own composition.
We seem to agree that structures like corporations are best seen as something that transcend the individuals that they comprise. And I think there are less harmful forms of organization, or at least what corporations can do should be limited by e.g. states and unions significantly more.
I avoid (and criticize) the use of "evil" because it usually muddies more than clarifies, and has weird metaphysical connotations. "Harmful" I think captures it better.
"Evil" because it can allow you to dismiss any moral values and basically be completely selfish without even noticing. You are just a small gear in the machine doing it's job. Even if it is doing some lousy paperwork, hauling some cargo to the port and then finally dropping toxic waste into the ocean. Reason for this is that corporation is a tool for "atomization of work" when everything is blended into small tasks and people are completely detached from the consequences of their actions.
So we as a human individuals profit from them greatly but also it can harm us because "they" act as cynical sociopaths. By they I mean corporations. With the use of "necessary evil" I was being hyperbolic But it is still double edged sword.
Cthulhu is definitely less evil than Meta.
Large corporate structures diffuse both responsibility and ability for coherent action.
Dealing with a corporation is like trying to communicate with some neurons in a brain. You might encounter helpful units, but the total sum of units operates at completely different levels.
C level execs deal with many issues directly, but inevitably have to delegate (to many levels) most of what they are responsible for. The ability of corporations to multitask in the thousands of threads (human tasks) comes with a price of lost coherence.
The structure of an organization becomes the overriding entity, one without any moral impulses, and highly insensitive to the details of myriads of problematic exceptional situations that individually seem very simple to solve.
But all the exception handling required to properly handle every problematic event would turn the organization to goo.
Especially talented & moral leaders can make a huge difference, bending the organization to prioritize a few important issues over others. But even they can’t close the gap overall.
And of course, many successful leaders we might think of as normal healthy people as individuals, are not the unusually talented moral leaders needed to deal with this complexity.
Wouldn't it just make them more dangerous?
Back in 2015, I participated in a genuine knighting ceremony, and it was re-enacted for photo opportunities. So there I was, on my knees receiving a sword to my shoulders from a knight in full regalia. Of course I eagerly posted the photo to Facebook and it was immediately rejected, I assume by AI only, because it was "male pornography". Yeah, I suppose I could see how the confusion arises there.
Unfortunately the false-positives of Trust & Safety can be a real hindrance to those of us who have genuine moments to share with others.
You can translate this piece from the SZ from 2016 to have an idea.
https://sz-magazin.sueddeutsche.de/internet/im-netz-des-boes...
As someone who reports on media and tech, I have to say: the way nothing changes with Meta and social networks even when their unethical and evil practices are exposed is one of the most frustrating aspects of my career.
With that disclaimer out of the way, (I think) it is distressing and damaging for young people to be doing this job. (And maybe the rest of the article goes on to say something like that.)
Still in today's world it is a job that has to be done. If it is to be done it should be by older more mature people with more life experience under their belts. And it should be revealed up front what the job is and how damaging it can be. I think you would have to be very spiritually grounded and take many breaks to refresh your spirit (mental health) to do this.
[1] https://en.wikipedia.org/wiki/Tobacco_Master_Settlement_Agre...
No one ever asks: Who shares those? Why? Do they ever stop? Can we discourage them from doing that?
People uploading this have reasons to do so. You can talk to them. I did.
What did they say?
If you want me to help you with your User experience research, let me know where to send the invoice.
He opened his dad's computer and found so many pictures of dead road accident victims.
He described some to me and I found it very disturbing just via verbal description. But he didn't seem disturbed at all.
But because the images of it (not the reality of losing a loved one, or the consequence of losing a parent) are gory, there’s nothing we can do to highlight we should care about more than ad budgets.
So to train the model you have to get hundreds of thousands, or even millions of images of the kind you wish to filter. Then get thousands of humans to look at them and label them. These people will suffer just the same as those interviewed in this article.
Going to war seems to mess up a good % of people. This stuff seems to have an even higher rate (near 100%?).
>Like other sacked moderators, she confessed to a feeling of withdrawal at being deprived of the graphic content she had grown accustomed to.
Quite surprised about that part - hadn't heard that before in other articles about this topic. Maybe that's what drives the people who post all this crap in the first place
Those exploitative weepy articles about content moderation are just multi-layered hypocrisy.
First of all, it is supposed that people are somehow entitled to “good experiences”, and the arbitrary (and moving) cultural boundary between “suitable” and “unsuitable” is as unquestionable as if it was God-given, when in fact, it's just a feature of an entertainment direct-to-screen service available to those from the luckier parts of the world/society. Others deal with the feces for them, as shown here.
Then there's the hypocrisy of the reader, who enjoys the thrills articles like those give, but also enjoys the service too much to stop, and leave the system of exploitation. Like, “It's so awful, so awful, but I need my daily dose of filtered cat pictures, so you're gonna get that sad dickpick spam in my stead. It's just the world we live in! The algorithm makes me continue doing that!”, etc.
Then there's the talk about values, correctness, and so on, but those decisions are not even personal in the first place. The “SFW” facade is not supported by some die-hard conservatives in power, it is just a business requirement. Say, breastfeeding is considered “problematic” not because of some “clash of cultures”, or “gender conflict”, or “religious opposition”, but because you can't use someone's body in that context to hold advertisements, as stated in contracts. Now go hide yourself in a ditch somewhere, don't spoil our pretty picture. Money happens to be religion here (what an original thought).
Some time ago, people naively believed in the future that eliminates travails and death, now we pretend really hard that the “future” is now, and build all kinds of media and social contraptions to make someone else do the “dirty” work (real or “emotional”).
I get you're angry but if everyone who complains about how awful social media can be while they themselves participate in social media are hypocrites and therefore shouldn't speak up (because... ???), how do you honestly see society being able to address the problem?
Heck even now, both you and I are participating in a limited form of social media, aren't we to hypocrites for complaining about the harm given your interpretation? I mean sure we aren't looking at "filtered cat pictures" (or maybe we are :P) but I don't see how what we're doing here is fundamentally different.
Perhaps the higher pay reflects the horrible parts of the job.