Mobile devices don’t have the memory or the memory bandwidth to run an LLM that’s big enough to be good at much. Plus the fixed battery and thermal constraints.
Unless the plan was just to build a RAG source from your personal data, in which case it would be yet another underwhelming feature.