Doesn't this send an awful lot of potentially private/sensitive browsing info to two places - your service and the LLM provider?
Chrome is even starting to ship a small Gemma model in the browser, but we haven't seen great performance from Gemma yet.
But yes, and I have the same concerns w/ this, code completions, Grammerly etc. Hopefully all these tools will follow the same trajectory (some usage with a cloud setup -> distilled into a small local setup).