the best would be on device inference only but we need maybe 6 months for a small model to match capabilities yet. I wanted to do it like that but even my pixel 10 suffered.