Gemini Nano coming built in to Chrome 126, powered by WebGPU

twitter.com

18 pointsastlouis443 comments

According to the paper[1], Gemini Nano-1 is 1.8B, and (Nano-2) is 3.25B parameters. They are quantized to 4-bits which makes them 0.9GB and 1.6GB respectively. That's a juicy binary blob to ship with Chrome.

As this will be on device, it will be interesting to see the inevitable reverse engineering of the model, if Google doesn't just release the weights.

[1]: https://arxiv.org/pdf/2312.11805

Yeah, that's beefy.

Although if it's available to websites as a browser api it can allow for some interesting applications.

I guess that's unlikely, but perhaps at least to plugins?

Open-web me screams no but tinkering me says yeah!

~1 GB built into the browser is a lot better than ~1 GB being stored by several websites/apps.

It is a bit of a concern for low-powered devices and mobile, though.

Reply on news.ycombinator.com