1,192 karma · joined January 1, 2024
You could also reimplement some QoL features like E2E search by building a local index of seen cleartext messages, or perform spam filtering via local NLP models—though in my experience, I never saw any encrypted spam. Threading UI might use a cleartext copy, or instead of Thunderbird's "Subject: ...", it could use a random UUID while preserving cleartext "RE: " patterns.
PGP is a very simple standard and could have become the default if not for some unfortunate client UX. If a major mail client automatically imported or generated a key on first install, required the user to write down a BIP-style mnemonic for private key recovery (PGP private key containers are quite large, so this might rely on symmetrically encrypting a provider-side backup), and attached the public key to every outgoing email—enabling end-to-end encryption automatically, with trust established on first use—I’d expect that a quarter of all human email traffic could have instantly become secure, eliminating decades of complexity built to sustain the illusion of trusted parties. A provider offerring this UX within an interoperable standard could be the only push it needs.
You might object to TOFU as suboptimal, but it has been the standard in many encrypted messaging systems: Signal, for instance, uses key servers to distribute keys and relies on users to verify shared secrets out-of-channel, as does WhatsApp. If this simple manual verification UX could be integrated with Web of Trust, it could automatically vouch for the user, showing a reference path for each of your contacts. Even without that, it is better to accept a one-time risk of key exchange compromise than to face the continuous possibility of eavesdropping.
The latter is what I mean. Web Integrity or SafetyNet are a closer counterpart to this situation than your curl example. A user agent is just a hint; attestation is an effective enforcement mechanism.
No Free Software license on my client can obligate your server to cooperate. But if attestation becomes the norm across many different services, the entire framework of user choice Free Software stands on collapses.
How would Ungoogled Chromium survive if every second website rejected non-Google Chrome? We've already seen this play out with Android: more people daily-drive GrapheneOS than Lineage because it passes Google's lower-level integrity checks.
And when a "strongly advised" government app requires the strictest attestation level, will you have to move countries just to exercise that freedom of choice you supposedly have?
The later half -- the freedom to change the program -- is meaningless in a world of attestation. Tivoization was explicitly forbidden on these grounds: if you can modify the software, but cannot use it in its modified state, the distributor is in violation of the spirit of free software and in particular, GPLv3.
It is a basic argument from positive liberty: the freedom for services to discriminate based on user's software and the freedom of the user to be discriminated against is no freedom at all.
It faced some controversy in its day. Do you think now is a better time for games like this?
I am sympathetic to whatever made you believe that, but if you advocate for such evil, inhumane, reckless systems, you are not a good ally to anyone, including yourself or your community.
If 3 attempts per hour is enough to gain access, then it doesn't seem attestation can save you. I imagine a physical phone farm will still be economically viable in such case.
As for compromised devices, assuming you mean an evil maid, Android already implements secure boot, forcing a complete data wipe when breaking the chain of trust. I think the number of scary warnings is already more than enough to deter a clueless "average user" and there are easier ways to fish the user.
For example, if a family encourages their child to work from the earliest allowed age at the expense of schooling, that's a manifestation of both economic and social pressures.
The many of the subjects tested never had any experience with this kind of formal testing, had little to no education, and of course predictably failed on several abstract tasks. It might be that the very pattern of sitting down and intensely focusing on apparently meaningless problems isn't as innate as expected.
Emergent Misalignment: Narrow finetuning can produce broadly misaligned LLMs [pdf] (martins1612.github.io)
179 points, 5 months ago, 100 comments