I'd be all for homomorphic encryption on inference, but as you say, this is probably mostly to prevent end users from observing intermediate results.
Homomorphic encryption for LLMs is extremely expensive and nowhere near computationally possible for the scale of current LLMs.
When I say things like that, I'm talking about a hypothetical version that would be computationally possible. I'm not talking about today's homomorphic encryption.
ooooooof yeah totally misinterpreted it lmao
Apple's Private Cloud Compute is E2EE between the client and the attested node. Not sure if anyone else is legitimately doing that -- Apple has definitely gone the furthest in terms of verifiably ensuring that requests and responses are not misusable by Apple.
to be fair, the title is very misleading, it took me a minute to understand what they meant
Given what we know about the company, I find it crazy anyone would misinterpret along those lines lol.
I can only say I am a little too optimistic about the technology world in general. Or at least would love to see some good news once in a while given the state of the world.