Theoretically, one could compile whisper.cpp to run in the browser using emscripten, maybe made faster with webgl...
I think this would be quite a heavy page load time for a website, but if the model file gets cached, and the user has a decent CPU/GPU, it... could work?