I keep a bookmark of your comment for my 2030 me.
Just to check whether that prediction will realize: Apple will ALSO storm the LLM market!
Apple will definitely push for on-device AI, but even in 2030 I firmly believe that they won't be leading the industry in performance. I'd be surprised if they even supported anything other than their proprietary CoreML by then.
A100: 1248 TOPS
MI250: 362.1 TOPS
M3 Max: 18 TOPS
Yes, 18. Unless Apple has accelerated INT4 workloads but just forgot to document it.
Honestly, I’m an Apple fan, but when they go on stage and say “AI” they mean it can do speech recognition or tell a dog apart from a cat, or autofocus a camera. It can’t run ChatGPT-like things by a loooong mile.