This is what I attempted with https://github.com/electronstudio/low_latency_dictation

However the accuracy of the real time models is poor, so I did a second pass with a higher accuracy model before committing the text.