This tech will happen the trick is finding ways of preserving privacy without degrading user experience too much.

Small open LLMs can enable a kind of differential privacy prompt rewrite system.