Why give this to developers if you haven’t been able to get Siri to use it yet? Does it not work or something? I guess we’ll find out when devs start trying to make stuff
What exactly are you referring to? Models do run on iPhone and there are features that take advantage of it, today.
The AI stuff with photography sure, but that’s more like machine learning.
The photo touch up thing is… useable? Sometimes?
What is it you’ve been so impressed with?
‘Writing tools’ is there in the text pop up now instead of ‘look up’ even if you’re selecting text on a webpage. It’s just in the way and useless.
(Since it's meant to restrict your children, using it to restrict yourself will disable some features that'd let you escape it. I forget what exactly, but you might not be able to change the time or something like that.)
> Ok its doing it in 4 or 5 products, but thats a joke.
Not every AI product is a chatbot.
Wow.
I'm currently on the beta, and I have a shortcut that pulls in various bits of context and feeds that directly to the on-device model.
I mean, the thing even lets me ask ChatGPT things if I explicitly ask it to! But why do I need to ask in the first place?
I don’t speak for Apple but certainly you can appreciate that there is a fine balance between providing basic functionality and providing apps. Apple works to provide tools that developers can leverage and also tries to not step on those same developers. Defining the line between what should be built-in and what should be add-on needs to be done carefully and often is done organically.
Q: Should search be core behavior or third-party functionality?
Probably Apple is trying to distill the models so they can run on your phone locally. Remember, most, if not all, of Siri is running on your device. There's no round trip whatsoever for voice processing.
Also, for larger models, there will be throwaway VMs per request, so building that infra takes time.
That said, "Private Cloud Compute" does run on proprietary Apple hardware, so availability might be a concern (assuming they don't want to start charging for it).