I helped build ByteDance's censorship machine
protocol.com
protocol.com
(You have a good memory!)
It's a really eye-opening article because everybody does Trust & Safety differently and in ByteDance's case there appears to be a huge divide between how US and Chinese users are treated.
TikTok is not Douyin. TikTok serves users outside of China, and ByteDance is aware that such extensive censorship would cause massive backlash against the app, so it is not done - especially when the public perception of China makes the company so precariously placed. As such, this is why you can still see posts about Uyighur Muslims and anti-China rhetoric on your FYP in TikTok rather easily.
With Douyin, censorship is state mandated. Practically every big Chinese tech company will have some advanced state-of-the-art censorship infrastructure for their Chinese users.
Some of these arguments for censorship made in this article sound eerily similar to how we justify censorship in the West.
> Our role was to make sure that low-level content moderators could find "harmful and dangerous content" as soon as possible.
Without context this could apply to any Western social media platform. Of course in the West its companies not politicians who call the shots, but the language to justify the actions is certainly similar.
I'm not trying to equate Western censorship to Chinese censorship, but in the West it's certainly fair to say many people are happy and even welcoming of censorship – is the same in China?
There's also a silencing effect if you're in a good quality of life that you don't want to potentially risk that by being annoyed about some aspects of society.
I think that applies to China and it applies to Iran. And you can see it in other countries where they have no policy change, but due to outside reasons the quality of life decreases and people start demanding policy and regime change.
In general people don't agree with it. However, for a lot of people, it's not actually on their radar.
The reality is most people in China are so engrossed in their work and day-to-day life that censorship isn't really actually an issue for them, and taking political action is not something that an average citizen would do considering the grave risks to your career.
Also, it's worth noting that most citizens prioritize safety over free speech. If changes in the law indirectly mean that there will be riots on the streets, most citizens would rather have whatever it takes to have no riots. That isn't to say people agree with censorship, but for what it's worth, people are happy that you can more or less walk around anywhere in China without much fear of your personal safety. Most people in Shenzhen were extremely happy they were in Shenzhen where you could walk around freely instead of "free" Hong Kong where you had to be in fear of idiot high school students throwing Molotov cocktails and beating up anyone who spoke Mandarin.
This happens in every society. There is an official ideology and whether through central direction or self-organizing systems, that ideology is enforced. Occasional periods of lighter repression (when the official ideology is something like classical or Rawlsian liberalism) end up just being openings for more assertive ideologies to take control. America recently exited such a period.
A half-century later, Rawlsian liberalism has fallen to wokeism, which has become powerful enough to overcome the cultural and procedural obstacles to establishing itself as the new ruling ideology, taking out the liberal framework that enabled its rise, and beginning its own campaign of repression.
Though you could say it was the American Revolution that set things off and that it merely took America 250 years to go through the progression that the French Revolution traveled in a mere 5 years.
That people believed it was more real than it actually was, is another matter. But this invites the question - was it really the social consensus? Or consensus among some subgroups of society that simply didn't run afoul of speech taboos?
(FWIW, I'm borderline free speech absolutist, so bear this in mind - I'm not arguing that extreme liberalism in these matters is a bad idea. Only that the past is not a good example of what it should be like, once you set the propaganda and cultural distortion aside.)
Nowadays, even believing something that half or more of the population believes is far outside of the Overton window and will ruin your career.
We're still quite a far way off from literally beheading people in the streets (and no, having your Twitter account banned is not even remotely comparable)
(I mean that we've regressed into repression)
Plenty of China watchers are happy to claim that Chinese people all support their government - and yet the government is curiously unwilling to test this assertion in democratic polls. Tells you something about how strongly held these beliefs are (hint: not very).
Do you support the National Park Service?
Do you support the Federal Aviation Administration?
Do you support the USDA?
Do you support Donald Trump?
Do you support the FDA?
Do you support NIST?
Do you support Joe Biden?
Do you support NIH?
Do you support public schools?
Do you support Guantanamo Bay?
Do you support the Environmental Protection Agency?
The Chinese government, although not democratically elected, is similar in one aspect, in that it is a very multi-faceted set of institutions that do a whole lot of things well that the majority of people support, and a few things that the majority of people secretly do not support but are unlikely to be vocal about.
Isn't it a brilliant tactic deployed by the regime, making people think that freedom of speech equals riot on the street. Like the USA is burning in hell with all the black live matters protest and the capitol protest/riot?
In a related matter, I wonder why mainland China came down so aggressively on Hong Kong's autonomy. Was the legal system in Hong Kong so lax that it was impossible to punish severely the main organizers of the illegal demonstrations? Why was the Hong Kong government so incapable of stopping the violence, but the mainland intervention so effective? I'm surprised China chose to abandon its international commitments and make it much harder to get Taiwan to agree with a similar or even more favorable arrangement.
If you are born into, grow up in, and continue to live in a society where all external information flowing into your society is filtered through government censors... would you even know it? If you did, would you think it's bad? Or is that just your government protecting you?
It's literally all you would know.
To understand that it's not that way everywhere... to understand there is a better way of life outside what you've experienced... to understand unfettered access to raw information is a good thing even if it makes your government/country look bad - takes experiencing it first-hand to contrast it against what you've got.
Although they are annoyed by the censorship, some of them would think that the censorship may be good for the country as it prevents 'unintelligible' people from being 'brainwashed' by western ideas, and act against the government/society or whatsoever. They claim that the censorship is to filter out those 'unintelligible' people from accessing information that they should not know, although this can't really justify the efforts the state put into censorship technology.
Those people are pretty happy to recent cases in western countries, such as COVID, BLM, Trump, and claimed that this is the advantage of their system that prevents such problem... And they also think that the western media also censor information, such as Facebook and Twitter bans.
Also, the great firewall is also beneficial to the internet companies, as this helps them to avoid competition with foreign companies, and can often just build a knock-off of the products of foreign companies... So the government really have the economic incentives to keep it.
Edit:
I am not living in mainland, but I know quite a lot of friends from there and I often read the articles in mainland websites (although I can't really post/edit them, as I don't have my identity verified for those sites).
For me, I would say that censorship is essential in every country. It may be helpful to censor information as done by Facebook and Twitter, but what mainland does is not only censorship: they arrest people for posting information against them, and their censorship is mostly not regarding fake information (as claimed by them), but rather information against the government. Some of them think that maintaining a harmony is good for the people, but censorship can't really make harmony, everyone understand that it is fake, but well, our opinion don't really matter now anyway.
That's not to say that America doesn't have LOTS of problems with censorship. We do. Oodles. Some of it's secret and some if it's blatant and in the open. But China is orders of magnitude worse for political speech.
Sounds like a great way to make us feel like we have political power and that our speech has power, when in reality the moment our speech can disrupt the establishment it gets clamped down. One big difference here vs China is that the establishment is a bit more distributed.
The people in power here are just as eager to censor as the people in power in China. The only difference is the people in power in China are mostly the people in control of the government. But the one bigger difference is that we only seem to think the government is capable of censorship, when really it's a matter of the people in power.
Of course, for the vast majority of people, living in a poor democracy is objectively worse than living in a rich dictatorship.
If you throw say a less well off and also oppressive government then it's a different matter.
My point is that free speech without impact is vastly better than no free speech at all, which is why I don’t see how it even makes sense to ask that question.
I think the key point is that free speech is the basic mechanism the public has to make societal or political changes. If speaking or protesting against the government is a crime, it means the public is lacking the basic mechanism to even propose such changes, let alone make them.
The US just changed administrations & congressional leadership twice in 4 years based on nothing more than ballot speech, which involved the humiliating defeat of one of the most well funded "establishment" politicians in favor of a non-politician that made a mockery of establishment practices for 4 years. Congress has representatives reviled by practically all of their colleagues and party management, yet they consistently get re-elected through ballot speech.
A series of news reports took down an entire presidency and the whole government couldn't do anything about it.
Allegations of sexual misconduct alone have sunk the careers of some of the most respected and powerful figures in multiple industries.
Protests & news reporting have directly led to historic civil rights legislation, and more recently: local council votes on police spending measures.
Sure, US politicians can be eager to censor but there are political & legal mechanisms that restrict and stop them. There is no such thing for the CCP. I've yet to see any checks on its power or speech about the CCP's atrocities & coverups affect the CCP's permanent leadership.
In US, the government may not come for you like China.
But in US, there are multi-national corporations, NGOs, think tanks, activist groups, social media mob who can just as effectively and "humanely" strip your power, influence and livelihood just as well as Chinese government can.
Also at least with China, rules are pretty black and white. Don't mess with the Chinese government's received view. However in US, it's ever-changing goal post, where opinions, jokes, scientific studies which were mainstream just a couple of years ago can potentially get you fired, bank account closed, socially shunned and be labeled with all kinds of things.
Is US actually better about freedom of speech than China in practice culturally?
To give you a negative example, a significant number of people organized a literal coup attempt, largely in the open, via social media, and nothing happened to them until they actually stormed the US Capitol building, after which some of them were arrested.
Large media companies with massive audiences broadcast divisive lies accusing the current President of being illegitimate due a fraudulent election. It is completely legal, and the government has taken no action to stop them.
Meanwhile, Jack Ma issued mild criticism of the Chinese government's financial regulation policies and promptly disappeared. And you're comparing that to "cancel culture?"
Yes, the US is actually better about freedom of speech than China.
And yes, the US government didn't do the censorship, but rather the private platforms that wield the power did so.
And then they actually went through with it - so many private organizations took action. And yet, the government did not force their hand.
ANT group has financial network power that can challenge the Chinese government's control over the country. In the future, if the power is unchecked now, it definitely can challenge the Chinese government. I am not casting a judgement whether that's right or wrong that a company has power like that. I'm just denying that Jack Ma's insignificant comment is what got him in trouble. What got Jack Ma in trouble is truly existential threat ANT group may pose down the future when a single entity fully controls financial activities of the entire Chinese population.
Compare to that, a bunch of idiots storming the capital building, is just that. A bunch of idiots storming the physical building. It's no threat. American regime barely was tickled by such an incident. It's embarrassing, but nothing significant will come out of it other than amazing leverage for the left to use. So props to that.
In comparison, Jack Ma and the ANT group's current and future influence in China is actually significant, lasting and potent, that can even rival Chinese government.
Yes, governments around the world have one thing in common, they are full of ASSHOLES. Actually, in general people are assholes. Bad things tend to happen.
You can have CNN and Fox broadcast different views somethings extreme, and many other media outlets expressing views somewhere between them. Try that in China, you would think twice if you are not even trying to PRAISE the government.
You cannot compare a demacracy to a authoritarian/dictatorship. They certainly always have something in common, the difference is level of oppression. The authoritarian are always on the extreme side, that's why they are called authoritarians.
Comparing demaracies to authoritarian is giving execuses to keep the oppressions going.
It's nice and necessary that you can criticize your government even in public. Don't give dictators execuses when your government pisses you off.
"What's the big deal?" asks the American. "I too can write that Russian elections are falsified on social media."
Original: https://youtu.be/gNXpa0M-UdY
Aside about the two parties: yes the two parties don't operate democratically, but they don't need to for the system to be democratic. Ultimately the voters choose and parties are held accountable for whatever actions they take. If a party subverts the will of voters, it will lose votes, or worse case scenario the parties die (eg. the Whig party, which was a major party).
You talking about Parlor or something else? I mean, when people can't use their non-majority social media of choice (whatever the reason stopping them may be), are they really free?
Parlor is one option, there's also Reddit, Pinterest, Snapchat, TikTok, the *chans, etc. There are decentralized networks like Mastodon. Neither the government or social media companies can stop you from choosing any number of social media platforms (or other communication platforms) to speak on. That is simply not the case in China.
You can swap out "Americans" with "Chinese" and you end up with the exact same thing.
"Chinese are free to speak whatever they want on platforms that are available to them." So are they now free too?
China also pursues dissent beyond its borders. Zoom, a company primarily develops their product in China, actually shutdown meetings with foreign participants because they were related to the Tiananmen massacre. The US FBI has revealed a covert CCP program called Operation Fox Hunt to coerce foreign dissidents into either committing suicide or returning to China's jurisdiction by threatening their family in China.
Frankly the difference between the US & China in degree of freedom of speech, both practical and theoretical, is astronomical. The two could not be further apart and even the most glib comparisons don't track.
So a more stable society will enjoy more censorship, and a less stable one may employ more, but that is constantly shifting and pointless to compare.
What is important to compare is the awareness of the participants that the system isn't fundamentally different (both systems allow for censorship, and actively employ it to control and preserve power). The problem isn't where this is more or less censorship, it's that in America we're taught that censorship, propaganda, and such dystopian tools are something unique to the Soviet Union, communists, China, etc, when really it's a universal tool employed by everyone from Donald Trump's office to Kellog's cereal commercials, and yes, the Communist Party of China. Yea sure, we have a million news outlets and China maybe has one, but if these tools are employed by those in power to preserve their power then you can be the people here in power employ them too. At the end of the day our million news outlets don't matter if 99% of the power is concentrated in 1%. It creates an illusion that there is independence when really the only thing matter is who has power and is in control, because they can rally these "independent" players when needed.
The gist of any centralized top-down censorship is that some ideas are just too dangerous to allow them in public discourse. It can be dressed up in slightly different terms - "social harmony" or "threat to democracy" etc - but it's fundamentally about the same thing.
> Is there a fraction of people who agrees with it or is almost it universally disapproved of?
There is a fraction of people who agrees with it. Otherwise it wouldn't be there.
But most people dislike, or at least are annoyed by, the censorship.
There are several different kind of dislike. There are people who are opposed to censorship in principle. There are people who find certain rules or mechanisms too ridiculous. There are people who only complain when it inconvenience them.
There are several types of supports. There are a small fraction of people who think that whatever the government does is for the greater good of the country. There are people who are happy when the fist hammers down on contents that they don't like, e.g. porn, anti-patriotic speech.
I'd say, anecdotally, most people find the current state of censorship somewhat unreasonable, but at the same time, have accepted it as a trait of the Chinese society that isn't going away in the forseeable future.
"Now that ... workers are superfluous, what do you do with them? First of all, you have to make sure they don't notice that society is unfair and try to change that, and the best way to distract them is to get them to hate and fear one another."
Of course, there are still topics that felt totally taboo in such half-personal/half-professional relationships; Hong Kong was a sticking point that we avoided, for instance, and I never would have dreamed of bringing up Tiananmen.
Social media censorship is not a big deal because we don't miss what we don't know. For example, people don't care they can't use google, facebook, instagram, because we have our own social networks. Also, people know not to talk about political subjects in these platforms because it is in bad taste and we know how to self-censor. Also, we Chinese see the chaos and mess from the news coming from the west regarding polarization, fighting between political parties, and social unrest and we don't want that. Contrary to the middle east, I would say most Chinese do not believe they are oppressed at all. They are happy with how the government handles things.
I'd say people are happy with the censorship because they believe it brings stronger national security, social stability, and reinforces shared cultural values most Chinese have with each other. Please keep in mind that we have different social values in the east than the west. Our perception of freedom and values that matter to society are quite different. Although this may seem extreme to you, your views sometimes seem extreme to us. Thank you for your time.
I haven't asked everyone I know, but based on my feeling most people don't like it. That being said, for most Chinese not liking the censorship is kind of like not liking a bad weather. You don't like it, but you accept it and move on.
Also based on my experience, most white collars (or at least ones working for international companies) in China have either direct or indirect access to the uncensored internet. Companies are allowed to purchase access to VPNs (legal, government approved) to bypass the censorship. This is so that they can access Google, YouTube, banned social media etc. to help them to do international business. Lot of companies integrate these VPNs directly into their corporate wifis meaning that all employees in the company network can bypass the censorship.
Despite having the unblocked access, I've noticed that only very few Chinese are interested in reading foreign news sources or using foreign social media/video platforms.
To be fair, I assume language is also a barrier.
I'm sure not going out of my way to learn Chinese to access Chinese language information sources. I would hardly expect the inverse.
Of course, for dictatorships that don't manage to achieve the dream for their citizens, you'll see a lot of cursing, name calling politicians, and even outright revolutions. People are essentially politically charged and actively involved with spreading news. This is seen in places such as Egypt and Venezuela, where the governments are only surviving because of being propped up by external agents, usually from the former type of autocracies. This mentality is also seen in quite a few flawed democracies.
And then there are the third type of autocracies, where people are simply desensitized to any news whatsoever. Places such as pseudo-democratic Afghanistan or autocratic Syria. People there only care about wanting to move away from that hell hole.
That seems like a loaded question. To be clear I don't live there and am not speaking for them, but from my perspective, as long as the country is getting more prosperous, people will overlook quite a lot. The same is true in the US, how well the economy does is what matters most in elections.
Considering the strong steady growth [0] they've had, I'm sure people are much more likely to overlook things like censorship if they think it will lead to better lives. And honestly, it may. I'm not promoting their censorship, but look how much better of a job they did handling COVID (after the initial cover up), while on the other hand look at the whole mess that the US had with the election and Capitol riot. The US makes it very easy for China to sell its way of government to its people.
However, the lack of transparency around flags and vouching on HN makes this meaningless, and I have never seen a flagged comment vouched back to visibility. Accordingly, I have reposted it below, although I would like to emphasize again that this is not an endorsement of its claims..
---- nglengjai 10 minutes ago [dead] | parent | unvouch | favorite | on: I helped build ByteDance's censorship machine
I can comment as I grew up in China my entire life and came to the west just a few years ago, attending international school. People obviously know censorship exists and most believe is for the greater good, as China needs social stability above all. Most people just want to live their lives, have children receive a good education, make money, have safety, etc. There is no need to bad mouth the government after everything they do for the people. So many families are now wealthy, business is booming, people can afford nicer houses, and the economy is doing better than ever. Crime and danger pretty much does not exist, cities are walkable, life is safe. My family and friends families were low-middle class when I was a kid and are now in the upper class by western standards. Also, you have to understand that Chinese culture, especially Han culture, is very united and shares a lot of patriotism. Family values are very strong, cultural morals I think are very homogenous. This makes it very easy for everyone to agree with government decisions. Contrary to the west, we have very high faith the the government is always doing the most efficient and safe decisions for the general public, and people are happy about it because this has been shown to be true with how it has concretely affected hundreds of millions of people's lives. So many people taken out of poverty within a short span of time.
Social media censorship is not a big deal because we don't miss what we don't know. For example, people don't care they can't use google, facebook, instagram, because we have our own social networks. Also, people know not to talk about political subjects in these platforms because it is in bad taste and we know how to self-censor. Also, we Chinese see the chaos and mess from the news coming from the west regarding polarization, fighting between political parties, and social unrest and we don't want that. Contrary to the middle east, I would say most Chinese do not believe they are oppressed at all. They are happy with how the government handles things.
I'd say people are happy with the censorship because they believe it brings stronger national security, social stability, and reinforces shared cultural values most Chinese have with each other. Please keep in mind that we have different social values in the east than the west. Our perception of freedom and values that matter to society are quite different. Although this may seem extreme to you, your views sometimes seem extreme to us. Thank you for your time.
Edit: you jinxed it! The post is no longer dead it would seem.
This is exactly why people don't even care about their words being censored. I live in China and 99.5% of my friends and family just use apps and platforms that "exist" in China. Those apps will even censor your private chats. They learned to self-censor and think it's good for them and their family. They just accept the censorship.
First of all, it's not a pro-CCP comment: it doesn't mention the CCP even once. Secondly, it was [dead] but not [flagged]. Many new accounts start out [dead] as a result of HN's automatic anti-spam measures, no human flagging involved.
So it's entirely possible to think that the CCP is full of parasites trying to mooch off the government while the people actually working in government are at least trying to grow the pie instead of just fighting for a bigger slice, or alternatively that the government is full of power-hungry people and the CCP's internal control mechanisms are at least limiting the worst excesses. So the two are not entirely synonymous.
Regarding the flagging status: this is what you copied:
> ---- nglengjai 10 minutes ago [dead] | parent | unvouch | favorite | on: I helped build ByteDance's censorship machine
If it had been flagged, it would have said so. Compare
frequentnapper 23 hours ago [flagged] [dead] | parent | flag | vouch | favorite | on: I helped build ByteDance's censorship machine
frequentnapper 23 hours ago [flagged] [dead] | parent | flag | vouch | favorite | on: I helped build ByteDance's censorship machine
Good catch, I guess I mixed it up with a different post.
25% of the people find it a nuisance, but don't speak out against it.
5% of the people actively use a VPN to circumvent it.
5% of the people oppose it out of principle.
5% of the people actively support it because they think it's a way to prevent "information warfare" from the West.
Almost identical. "Terrorist" viewpoints/content and "hate speech" are banned and censored in most Western countries.
The reality is a bit different:
https://twitter.com/RealSexyCyborg/status/133971634103760076...
https://twitter.com/RealSexyCyborg/status/134857871356311961...
I think that it boils down to: if you're obviously making fun of an head of state (i.e. you have a meme/image with both Winnie and Xi Jinping) it's going to be recognized as such, and taken down... But Winnie by itself (or the memes in foreign contexts) aren't really at risk of getting banned.
https://www.bbc.co.uk/news/blogs-china-blog-40627855
It actually reminds me of something that happened in Italy 15 years ago:
https://www.repubblica.it/2006/11/sezioni/esteri/benedettoxv...
The police entered the newsroom of the Manifesto, from which a bunch of leaflets had been thrown. On it you could read "Pastore Tedesco", referring to the German Pope (a wordplay on him being a pastor, and the German Sheperd dog breed)
Authorities can seem really thin-skinned, given that in both cases it's an almost innocuous comparison that is being teased (to a cartoon bear, or a dog breed)... But given that these were targeted to an head of state, it's not too surprising.
Obviously, censorship is not only about memes...
On one hand censorship hinders internal transparency and makes it difficult to hold the government accountable. On the other hand information warfare is a thing, especially between geopolitical rivals, censorship is a cheap way to mitigate against them.
For what it's worth, there are increasing voices within the chinese government that are advocating for removing the great firewall because the new generation of chinese are more and more confident with their own political system.
And I think that it may be more justifiable if the censorship is also towards fake information and hate speech, but sadly this isn't quite true (check weibo or something). This is purely something political.
...every audio clip would be automatically transcribed into text, allowing algorithms to compare the notes with a long and constantly-updated list of sensitive words, dates and names, as well as Natural Language Processing models. Algorithms would then analyze whether the content was risky enough to require individual monitoring.
If a user mentioned a sensitive term, a content moderator would receive the original video clip and the transcript showing where the term appeared. If the moderator deemed the speech sensitive or inappropriate, they would shut down the ongoing livestreaming session and even suspend or delete the account.”
We must reclaim the public square if we wish to retain democracy.
I think I've changed my mind.
This deeply saddened me. They reason why the Uyghur dialect wasn't banned wasn't for ethical reasons, but base operational ones.
It's like when the bloody Franco dictatorship forbade the Catalan dialect decades ago.
US tech firms were positioning themselves as adversaries of the previous president. We'll see how things play out with the new administration.
These are the careers that we have chosen and stuck to because the benefit to us outweighs the harm to society. We are aware of what we're doing and also apathetic about it.
A person complaining about their employer being somewhere between morally indifferent and morally monstrous is a reflection of how incredibly normal this is. Users on this site reading this person's complaints and tut-tutting about how bad it sounds is a reflection of how normal this is. We are all neck-deep in the filth of depravity, willingly and gladly, and we're pontificating the important differences between the filth reaching ear-level or just mouth-level.
Because they are beholden to the government, corporate control over the public square has us all fucked. Today people cheer Big Tech’s ability to censor distasteful politics from the public square. Tomorrow, when “content moderation” makes civil disobedience impossible to publicize, we will lament the lack of decentralized social media.
In other words, centralized social media cements moves towards authoritarianism, but makes it very difficult to move back in the other direction, especially if attempted via the most tried and true methods in history.
The revolution won’t be televised. You won’t find it on Twitter or Douyin either. So why did anyone expect anything different? Unless the people can take back control of the public square from the corporations, democracy will crack.
Edit: consider responding with something coherent rather than downvoting and moving on
> I am not sure what is news here.
In fact, the Chinese government goes to great lengths to downplay and hide the extent of their censorship efforts, and it might actually be a surprise to some people. It is worthwhile discussing ALL forms of censorship, whether it be by the NSA, Beijing, or corporations. The only way we can deal with these issues is by discussing them at length and raising awareness.
The fundamental problem here, underlying both Chinese and American censorship/surveillance, is that we have willingly handed control of the public square over to an entity beholden to one that does not have our best interests in mind.
So long as we let the public square rest in the hands of these entities, democracy will slowly slip from our hands, one ban and censor at a time.
You can’t blame China or ByteDance or Twitter or the NSA for this sort of thing. The natural state of governments and corporations is vying for more power and wealth at all costs, democracy be damned. The blame rests on us, the people, for trusting corporations with our speech.