Hacker News Reader

Is diarization only possible with stereo audio at the moment in whisper? If the voices aren't left/right split I don't think one can get them separated yet.

https://github.com/Wordcab/wordcab-transcribe

Author of Wordcab-Transcribe here. We use faster-whisper + NeMo for diarization, if you want to take a look.

Nvidia's Nemo has some support for speaker recognition and speaker diarization too.

https://docs.nvidia.com/deeplearning/nemo/user-guide/docs/en...

Whisper cannot perform speaker diarization at the moment, WhisperX and other solutions that can tend to use pyannot https://github.com/pyannote/pyannote-audio

Same here. Whisper is really good at transcribing Greek but no diarization support, which makes it less than ideal for most use cases.

I'm the creator of Revoldiv.com, We do speaker diarization and transcription at the same time. Give it a try.