Google is bringing AI to the browser with WebGPU in Chrome

which makes this works in the browser

https://mlc.ai/web-llm/#chat-demo

My bet is that they won't because their worst competitor - MS - has better LLMs and a browser, Edge, built on Chromium. Whatever Google adds to WebGPU will be given for free to MS.