ali_chherawalla

appreciate it!

yeah seems pretty insane!

Thats pretty interesting. with what is possible with openweight models now, having this multimodal functionality on your device itself will be quite next level

understood.

I'm curious what the point is though?

this is super interesting. Looking forward to trying this out!

Healthcare has the strictest compliance requirements of any US industry. The most sensitive data. Twenty-five new state AI regulations introduced this year alone.

It also has the largest gap between AI deployment and AI governance of any sector we looked at.

Three out of four US health systems are running AI in 2026. Less than one in five has governed it. That is not a laggard industry failing to adopt — it is an industry that adopted faster than it figured out what it was doing. The compliance exposure sitting inside most health systems right now is not hypothetical. It is running in production.

We mapped this across financial services, healthcare, energy, manufacturing, and logistics. Healthcare was the one that made us stop.

Full report: https://mobile.wednesday.is/the-enterprise-mobile-ai-report-...

awesome. I'll let you know once thats in

fair point, let me know work on that. That's a small lift.

lol thanks buddy!

I'm working on that we speak. Shouldn't not be that difficult of a lift and should be able to do that tonight or in the next couple of nights

ofcourse ofcourse,

I've documented everything here: https://github.com/alichherawalla/off-grid-mobile-ai/blob/ma...

llama.cpp compiled as a native Android library via the NDK, linked into React Native through a custom JSI bridge. GGUF models loaded straight into memory. On Snapdragon devices we use QNN (Qualcomm Neural Network) for hardware acceleration. OpenCL GPU fallback on everything else. CPU-only as a last resort.

Image gen is Stable Diffusion running on the NPU where available. Vision uses SmolVLM and Qwen3-VL. Voice is on-device Whisper.

The model browser filters by your device's RAM so you never download something your phone can't run. The whole thing is MIT licensed - happy to answer anything about the architecture.

you're doing the marketing for me ahaha! appreciate it though. thank you

dude thats awesome to hear! I literally added support for web search, tool calling and KV cache optimization support + usage of all 99 GPU layers a few hours ago!

Those changes are not live on the play store / app store but its available on GH. I'll make a release later today.

Let me know what you think!

Off Grid is now live on the App Store: https://apps.apple.com/us/app/off-grid-local-ai/id6759299882

Off Grid is live on the playstore now. Check it out: https://play.google.com/store/apps/details?id=ai.offgridmobi...

I think thats a bug, I'm guessing you're trying one of the NPU models? If you drop to CPU for now it should hold.

Only phones with qualcomm chips are able to use the NPU. I'm working towards changing that.

but yeah just to be clear there is no internet needed to run any of this. Infact I'm so averse to it, I've not even added analytics for this one. So flying pretty blind here.

it doesn't need internet to generate an image. it needs it to download the model, and to be fair if you've got the zip for the model already you can just import that

awesome. thanks!

sure, I'll take a look at it. Thank you for the recommendation

awesome. The more the merrier. Feel free to get started.

I'm still working on a few things, but let me get a backlog in place and push it so people know what the roadmap looks like

hey! thank you for the feedback. appreciate it. I pushed something recently that actually prevents showing up models in the download screen that don't fit on your phone. Please give it a whirl.

Yeah it wasn't straight forward figuring out the speed + getting it to work for both Android and iOS. Fair bit if complexity. But I'm so happy I got it done.

i'm adding another feature to recommend models based on h/w. that should take care of this stuff

I don't really do TTS right now, but i allow for STT using whisper. TTS is part of the backlog and I should be adding it soon

with the metal infra its actually quite good. Agreed you can't run really large models, but inference is very fast and TTFT is very low. It's a beautiful experience

awesome

thank you, appreciate it!

i don't think they do image gen etc? You can almost think of Off Grid like an on-device assistant. It'll handle everything like vision, and attachments too. We're still early stages and lots of optimizations to do, but we'll get there.

yup just updated. Thanks!