Hacker News Reader

Apple includes a local LLM on all recent iPhones, https://developer.apple.com/documentation/foundationmodels. Seems like a bad idea to force your users to download a 3GB LLM just to parse a text field.

View on HN

Yeah but I need broader coverage on older phones. No I'm not going for a 3rd party LLM. Foundation Models for iPhone 15 and newer, and a parser for the older ones. Currently training a Word Tagger in Create ML

Reply on news.ycombinator.com