Yup, I agree. And this is why I think mass surveillance isn’t just another technology to regulate. The chilling effect isn’t misuse; it’s the default: continuous, opaque observation changes behavior by itself. Because it’s centralized and unavoidable, people self-censor and conform; you don’t need arrests once everyone assumes they’re being scored.
We don’t yet have long-run examples of fully algorithmic surveillance societies, so the outcome isn’t certain. But if these dynamics scale, the risk is trading experimentation for legibility. Problems get hidden, metrics look clean, and warning signals vanish. When real stress hits, responses are late and blunt - overcorrection, cascading failures, accelerated exit. Stability holds until it doesn’t.