Comment by stevenjgarner | Hacker News Reader

Comment by stevenjgarner | Hacker News Reader

Parent Full thread

There is a gradual chilling effect of self-censorship to mass surveillance and loss of anonymity. When you know you are being watched, you change your behavior. You don't visit the "wrong" protest, you don't meet with the "controversial" whistleblower, and you don't seek out the "unpopular" doctor. Total surveillance creates a "soft" totalitarianism where citizens police their own movements to avoid falling into a "high-risk" algorithm, even if they've done nothing illegal. At its extreme, such societies end up with no outliers, no more of "the crazy ones. The misfits. The rebels." (Steve Jobs). Safety and compliance at all cost.

The peer-reviewed consensus of this in psychology describes a three-step internal process of Anticipatory Anxiety, Risk Aversion and Self-Censorship [1]. The Conforming Effect (Conformity Theory) has been measured in studies such as those by Jonathon Penney (2016/2021), where use of Wikipedia data and search traffic shows a statistical drop in "sensitive" searches (e.g., about "terrorism," "human rights," or "health") immediately following news of government surveillance. [2]

[1] Surveillance as a Socio-Technical System: Behavioral Impacts and Self-Regulation in Monitored Environments, https://www.mdpi.com/2079-8954/13/7/614

[2] Chilling Effects: Online Surveillance and Wikipedia Use, https://lawcat.berkeley.edu/record/1127413?v=pdf

Yup, I agree. And this is why I think mass surveillance isn’t just another technology to regulate. The chilling effect isn’t misuse; it’s the default: continuous, opaque observation changes behavior by itself. Because it’s centralized and unavoidable, people self-censor and conform; you don’t need arrests once everyone assumes they’re being scored.

We don’t yet have long-run examples of fully algorithmic surveillance societies, so the outcome isn’t certain. But if these dynamics scale, the risk is trading experimentation for legibility. Problems get hidden, metrics look clean, and warning signals vanish. When real stress hits, responses are late and blunt - overcorrection, cascading failures, accelerated exit. Stability holds until it doesn’t.

I think especially heinous is the use of Zero-Knowledge (ZK) Proof technologies where a centralized attestation authority (e.g. government agency) verifies compliance, and the verifier (e.g. business needing to prove compliance) relies on the ZK cryptographic proof of compliance without revealing the individual. This revocable privacy can unmask the real identity in the case of asserted "suspicious" activity. This is the current direction of mainstream technology, and all it serves to accomplish is a normalization of loss of privacy and anonymity.

Tech-minded folk will clap like trained seals, as second-option bias takes over, when someone big on the fediverse suggests implementing ZKP algorithms to comply with identity attestation laws.

It's sad, but not surprising, to see. We'll design the most secure systems with the new shiny just to confirm whether the government believes you should be able post on Reddit or not.

>Total surveillance creates a "soft" totalitarianism

And every step of the way the enablers will defend it on the grounds of "well you still technically can do the thing if you're willing to put up with some absurd risks or jump through some insane and impractical hoops specifically designed to be non-starters for many/most."

Reply on news.ycombinator.com