My biggest concern is that it will degrade my phone sooner and its battery life. I rather just hit an LLM in the cloud somewhere from my phone.

If the tech ever reaches the point where Apple can fully do, on device-first and there's no issues with it, then they'll likely invest drastically into it.