Very interesting - I was sort of expecting it to happen soon.
I have been playing with using Whisper + Github Copilot in Vim [0]. The Whisper text transcription runs offline with a custom C/C++ inference and I use Copilot through the copilot.nvim plugin for Neovim. The results were very satisfying.
Edit: And just in case there is interest in this, the code is available [1]. It would be very awesome if someone helps to wrap this functionality in a proper Vim plugin.
[0] https://youtu.be/3flN9kTcZJY
[1] https://github.com/ggerganov/whisper.cpp/tree/master/example...