Hacker News Reader

The Android apk for MLC is updated frequently with recent models built-in. And a Samsung S24+ can comfortably run 7-8B models at reasonable speeds (10ish tokens/sec).

https://llm.mlc.ai/docs/deploy/android.html

I have an (mlc-llm based) app on the App Store that supports over 2 dozen models, including some recent ones.

cnvrs runs GGUFs on iOS: https://testflight.apple.com/join/ERFxInZg

wat

https://huggingface.co/mlc-ai

On my iphone there doesn’t seem to be an option to download more.

Vaguely recall there being a button initially but don’t see it anymore