fwiw Google is attempting the same thing, but they're not doing much better.

https://www.notebookcheck.net/MrWhosetheboss-video-reveals-G...

> Google's Pixel 8 Pro Tensor G3 off-loads all generative AI tasks to the cloud