Privacy is close to my heart too. It's just a balance between privacy as a need vs operation speed and intellectual property. To be decided.

Inference can be totally done client-side. Later measurement tuning would be much harder.