On-Device Acceleration of Large Diffusion Models

arxiv.org

9 pointsmztwo3 comments

> Google LLC

Now we are talking. Stable Diffusion getting some assistance in on-device usage.

Won't be surprised to see Apple join in.

Apple ported SD to CoreML almost immediately, and pushed it to Github!

That being said, they havent really turned it into a product.

> That being said, they havent really turned it into a product.

I don't think they need to, since they are also AI shovel makers due to their Apple Silicon chips.

So I guess that they will push for on-device LLMs soon. Won't be surprising to see that on iPhones and Macs.