247 karma · joined September 26, 2016
sachaservanschreiber.com
For instance, when I program with Cursor, that data is sent to Cursor severs, then to their tooling and analytics third parties, then to the foundation model providers, then gets trained on, etc.
[1] https://arxiv.org/abs/1204.2136 [2] https://arxiv.org/abs/2210.03458
Unfortunately, as described, such a solution would only satisfy a somewhat meaningless notion of privacy. Specifically, the embeddings by definition contain potentially private information about the user, revealing things like "I'm asking about birds" to use your example. Even though it might "compress" the query in a slightly lossy way, it would still reveal a great deal of information about the query.
A true solution to this problem would require something like differential privacy and adding noise to the embeddings. However, the noise required would (likely) end up destroying too much information from the embedding to preserve accuracy of the LLM.
> How are HN users handling this? I’m working on a startup for end-to-end confidential AI using secure enclaves in the cloud (think of it like extending a local+private setup to the cloud with verifiable security guarantees). Live demo with DeepSeek 70B: chat.tinfoil.sh
What typically makes FHE expensive computationally is a “bootstrapping” step for removing the noise that accumulated after X operations and threatening correctness. After bootstrapping you can do another X operations. Rinse and repeat until you finish the computation to you want to perform.
https://theprivacyblog.com/blog/anonymity/why-tor-failed-to-...
There was a scandal back in 2010 where a high school in Philadelphia was accused of spying on kids through school-issued laptop webcams [1], which is arguably more egregious.
https://www.computerworld.com/article/2521075/pennsylvania-s...
[1] https://www.nytimes.com/interactive/2019/12/19/opinion/locat...
One nitpick: it would be helpful to only have to type out the words on the page rather than different symbols (maybe having it be a toggle). For example, in The Art of War, typing out all the bullet points and numbering can be tedious and not really what I'm looking for from a typing exercise.