Hacker News Reader

So you have some fun examples?

Maybe I oversold the fun-ness of it. The most common failure mode is that it goes into loops and you come back to find it exhausted the output length without getting anywhere.

Sadly crashing on Pixel 9 Pro, but I guess phone GPU with 16GB RAM total wouldnt be enough anyway.

It should be though.

Even native AI gallery uses smaller Gemma models. I guess whatever Chrome is using for WebGPU compute on Android is just adding too much overhead.

Runs on my 16GB M2 Air (firefox). ~7 tok/s

3/16 GiB of RAM on the P9Pro is dedicated towards on-device AI models, which WebGPU probably can't access.

To be fair, the GPU in pixel 9 and 10 is pretty bad.

I really hope they stop using PowerVR in pixel 11.

40 tokens a second on my M4 Max (Safari). Wild times.