I’d love to replicate your workflow. Any luck with speaker diarization using whisper? I’ve tried WhisperX several but it didn’t work.
At the moment it runs on AWS, and we're thinking of open-sourcing so you could also run it locally to maintain 100% privacy of such conversations.
You'd get speaker diarization, names on top of the recording [2].
[1] https://aimeetingbot.com [2] https://spoke-1.gitbook.io/ai-meeting-bot
Happy to get in touch and have you run it