> Apple’s model has extremely low latency (0.6 milliseconds to first token), outperforms similar sized Phi and Gemini models from Microsoft and Google.
From [1] it is 0.6 millisecond per prompt token so unless the prompt is one token the latency would be higher.
> Apple’s server-side models running in the Private Cloud Compute are apparently quite near the GPT-4o in terms of quality
The benchmarks from [1] never mentioned GPT-4o, the best model they compared to for the server model is GPT-4-0125. If their model almost matches GPT-4o they wouldn't need to integrate with ChatGPT.
[1]: https://machinelearning.apple.com/research/introducing-apple...