Yep, we agree that the obvious direction of innovation for OSS models is smaller and cheaper, likely at roughly the same quality: https://generatingconversation.substack.com/p/open-source-ll...
So eventually you could be running decent sized models locally (iOS could even provide an API with fine tuning etc)