I just tried the android application, really like the privacy first approach. Would you consider adding BYOK so that a user could have complete control over where inference happens? I realize it might not fit your architecture, but it seems like a neat optional setting. Either way, neat project.