Hacker News Reader

Comment by xcv123 | Hacker News Reader

Why would you expect that? State of the art LLMs need a GPU with hundreds of GB of RAM costing tens of thousands of dollars. Apple doesn't have magical supernatural powers. They are still bound by the laws of physics. Siri is still running on device (mostly) and is quite powerful with this new update.

View on HN

in the past Apple has made the choice to gimp their functionality before sending data off-device - one of the reasons Siri has sucked so badly. This seems like a distinct change here, finally conceding that they just can't do it on device and be competitive. But I forsee they now have a much more challenging story to tell from a marketing point of view, now that they can no longer clearly and simply tell people information doesn't leave their device.

I've been using Siri more often recently and surprised at how capable it is for something that runs entirely on a phone. The speech recognition is perfect and it can do basic tasks quite well. Send messages, lookup word definitions, set timers and alarms, check the weather, adjust timers/alarms, control Spotify, call people, adjust the brightness and sound level, control lighting in the lounge, create and read notes or reminders, etc. It all works.

"There is no way we can reduce the size of transistors" - You in the 20th century.

Apple uses TSMC for fabrication. The roadmap for TSMC and Intel are planned years in advance.

Two orders of magnitude improvement in 6 months? Not possible. Have you heard of Moore's Law? Maybe in 20 years.

https://en.wikipedia.org/wiki/Moore%27s_law

- Doesn't read article

- Doesn't understand not every LLM needs to be ChatGPT

- Links Moores Law wikipedia

I give up.

Try reading the thread before mindlessly replying.

"I fully expected them to announce a stupendous custom AI processor that would do state of the art LLMs entirely local."

State of the art LLM means GPT-4 or equivalent. Trillion+ parameters. You won't run that locally on an iPhone any time soon.

Reply on news.ycombinator.com