Hacker News Reader

Comment by crooked-v | Hacker News Reader

To me, everything about how it's been presented so far says the point of how it's set up is that they don't want to use backends. They want everything to happen on device. Even having ChatGPT for expanded queries is an unfortunate necessity driven by the hardware not being powerful enough yet.

How much is run entirely on device so far is unclear, but the sessions later in the day should expand on that.

View on HN

On device or in an Apple owned DC. It sounds like they have aspirations for their own Apple owned LLM. ChatGPT seems like it's there until they can get something good enough to generally replace it for cases where their in-house solution isn't capable enough yet. They likely continue to invest heavily on big capable LLMs as well as ones that are small enough to run on device (while working on the hardware side to ensure they have the device capabilities to run more powerful models on the device).

The benefit of owning the last mile to the customer is that you can choose when you want to replace default Maps, or not.

So, the company that brought us Siri is going to build something better than ChatGPT... something that will run on-device no less. It's just not quite ready yet. Got it.

Siri was quite impressive when it came out. I just felt it never got significantly better until it became an embarrassment

It never was impressive. It only made cool demos and Apple aficionado worked the reality distortion field like crazy since then. It's actually embarrassing how bad it has always been compared to the Google stuff announced later with less fanfare.

I don't even care much because I don't think "assistants" are good for much of anything, but if I have to use one, Siri is not the one I would like.

Yeah, by having literally a shitton of cash, and having bought multiple ML startups over the years. Plus it’s not like they couldn’t make Siri better, multiple projects had internal problems with Siri and were trying to get it replaced, but none went anywhere, possibly because higher ups planning ahead with this.

Reply on news.ycombinator.com