Does anyone know of a real time version of this, that can immediately transcribe individual words? Could be very useful for those hard of hearing.
https://whisper.ggerganov.com/stream/
It chunks the input in 5 second buffers and processes them independently. Results and performance are not great, but I think good enough for a proof-of-concept.