Apple is testing an AI chatbot but has no idea what to do with it

theverge.com

5 pointsdkobia6 comments

Mmm, too bad Apple has been so stingy about RAM capacity on its devices.

Otherwise they would be the perfect platform for local LLM inference.

In other words, Apple is the only one making devices that can actually make do with that little RAM?

With a caveat.

While the initial performance is excellent, Apple devices start to chug as iOS/OSX grow and other apps get more RAM hungry.

> Apple devices start to chug as iOS/OSX grow

sure, but this is controlled. they're not overcompensating like everyone else has to. they know what they're doing (their obsolescence is planned)

[dupe]

As with every Verge post almost...