Check out “Bring an LLM provider to the Foundation Models framework” -
https://developer.apple.com/videos/play/wwdc2026/339
- Application can ask for specific model, if available use it. if not, ask to download it (or try some fallback / alternative)
- User can manage models. So as a user I can clean unused models (and for non-techie have something similar to offloading apps when unused for some period of time).