Privacy & Security with self-hosted LLMs! You have dreamed of this too?
Today you you can self-host some models, yet this does not mean you can safely browse the web with it, and automate tasks that would interact with your email account, your bank account and your clients.
This is the reason why I left Mozilla, to work full-time on fixing these problems.
Prompt-injection, hallucinations and private information leakage might not be fixable, but they can be identified 100% of the time, deterministically, before any undesirable consequences.