Comment by m3kw9 | Hacker News Reader

Top New Best Ask Show Jobs

Comment by m3kw9 | Hacker News Reader

Parent Full thread

Yeah soon there will be models small enough to run even on phones to reword things slightly differently. If not, an app will do it

I already have one running on my phone: https://mlc.ai/mlc-llm/

you are very kind thank you

This crashes on my Android device

I know about this app, in fact I’m one of your beta testers, didn’t know it was running local models lol. But this thing almost 2gbs.

Installed on my S21, it just crashes whenever opened.

I use Sherpa to run 7B and 13B LLaMA/Alpaca models on my phone: https://github.com/Bip-Rep/sherpa

Reply on news.ycombinator.com