Consumers don't care about whether an LLM is local, and one that runs on your phone is always going to be vastly worse than ChatGPT.
I see zero indication that Apple is going to replace people going to chatgpt.com or using its app.
All I see Apple doing is eventually building a better new generation of Siri, not much different from Google/Alexa.
People definitely will care that such private data stays safely on the phone. But it’s kind of a moot point since there is no way to share that kind of data with ChatGPT anyway.
I think Apple is not trying to compete with the big central “answer machine” LLMs like Google or ChatGPT. Apple is aiming at something more personal. Their AI goal may not be to know everything, but rather to know you better than any other piece of tech in the world.
And monetization is easy: just keep selling devices that are more capable than the last one.
So I don't see what unique advantage this gives Apple. These days people's data lives mostly in the cloud. What's on their phone is just a local cache.
Sorry, this just made shivers run up my back.
If I ask Gemini a question, I definitely want it to be able to search everything in my calendar, Gmail, Drive.
No shivers here. Do you get shivers from using the search box on your Google Drive too?