Hacker News Reader

It would be nice to be able to run llama.cpp on my phone but if I had the choice between that and a root shell and c compiler I'd definitely take the shell.

View on HN

Private AI app in play store wraps llama.cpp

Heh I guess that's a good point. All I have is a ten year old iPhone just to run Cisco DUO for work and there seems to be no way to run llama.cpp on it even with a very small model.

Occasionally I'll use i.sh to ssh into a decent computer but it would be nice to be able to just run normal software on it.

It will probably run 2B models, there are many more options for iOS, try it out.

Reply on news.ycombinator.com