ali_chherawalla

I agree. I mean mobile devices have only been getting more and more powerful.

I actually think you should give it a spin. IMO you don't need claude level performance for a lot of day to day tasks. Qwen3 8B, or even 4B quantized is actually quite good. Take a look at it. You can offload to the GPU as well so it should really help with speed. Theres a setting for it

LM Studio does it well. Along with being a system integrator for SD, and text models I've tried to create a very good chat experience. So theres some sauce over there with Prompt enhancements, Auto detection of images, English Transcription suppor, etc

hey, just pushed a fix for it here: https://github.com/alichherawalla/off-grid-mobile/releases/t...

Thanks for spotting and reporting this.

I've added a section for recommended models. So basically you can chose from there.

I'd recommend going for any quantized 1B parameter model. So you can look at llama 3.2 1B, gemma3 1B, qwen3 VL 2B (if you'd like vision)

Appreciate the kind words!

wow. thank you

sorry about that one. I'm taking a look and fixing it right away

ok, let me figure that one out.

thank you!

yup, just took a look at that and fixed it. My bad!

yeah thats right. for now for iOS you'll actually have to pod install etc.

Thanks for pointing this out

LM Studio solves for it pretty well I think. It doesn't do image gen etc though

Thank you!

hey, yes. thanks just pushed that fix out