chrome://flags/#prompt-api-for-gemini-nano to enable this on current Chrome (at least on Linux). It worked after I enabled that flag and restarted Chrome, though it required two tries (apparently it needed to download a model).

I tried to figure out if this stuff was available in other browsers but unfortunately came up short.

Googler, opinions my own.