Alpaca 7B running on Google Pixel 7 Pro

github.com

I was able to run alpaca 7B model on Pixel 7 Pro.

that's pretty inspiring! Any drawbacks? What is the time delay (which I realize are dependent on a lot of factors) between input prompts -> result of what you have tested?

Reply on news.ycombinator.com