Email, etc, is all Apple inference, the presentation strongly implied that was on-device. The system always explicitly asks “Ok to send this query to OpenAI?” or user initiated request.

I think the Apple server inference is handling things like image generation where you need a beefy guy to get results quickly, and don’t need to transmit as much user context to service the request.