Hacker News Reader

Comment by crazyeng | Hacker News Reader

Just playing the devil advocate: what happens when the answers from a not-Apple LLM are garbage? Who the users are going to blame, Apple or OpenAI, Anthropic, etc..? I'm not 100% on Apple side on this, I would love to chose whatever I want, even local models, but I get why trey trying to control 100% of the user experience. If they could trust any provider with customers data, they would let them in, since they're not competitors. They would even let Apple not spend a ton of money on developing LLMs....

View on HN

Are people blaming Apple when Google search in Safari gives garbage results? Some probably are, but that really shouldn’t be a relevant discussion, in particular when the user explicitly chose which AI backend to use.

Well, we can generalize this a bit to model routing in general. Actually, just AI in general - even when directly interacting with GPT we haven't figured out good protocols yet.

I don't think your example fit this scenario: when you search things in google, you know you are using google. When you ask Siri to do something and the answer is garbage, where the issue lies? It's Siri not giving the right context? It's Siri that is not providing the correct tools to the LLM? Or it's the LLM that botched it? We already see these kind of issue with LLM and harness, and we are talking with developers that "should" know how to move in this scenario ;)

If you are smart enough to change the default, you would know which LLM you picked and could point the finger at it.

Apple is in the game of providing an application platform. Maybe in the future they will provide their own LLM.

In house memory is more important...

See my comment above: unfortunately Siri and the LLM provider are interwiven, there is not clear cut border between the two, even for experienced users

Why, the users will blame anyone but Apple, of course.

I can promise you Apple is constantly being blamed by its customers for things out of its control. I worked at an Apple store for years. All sorts of carrier issues, third party accessories, and app problems were chalked up to Apple screwing up.

Reply on news.ycombinator.com