What on earth would you do with an iOS device that has 96GB of RAM? You realize the last generation (i.e, the most powerful consumer phone in the world today) had 12 GB of RAM? You feel the need for eight times that amount?
I am not sure single digit tk/s on weak model like ChatGPT OSS 20b @ Q3_K_M is going to be worthwhile.
Not to mention this has to be <0.01% of users who "want" to do this. The iPhone tooling would make it hard to even configure and spin up a local LLM.
You can't possibly expect Apple to take that market segment seriously.
According to what? (I don't disagree, just curious)