Ask HN: Anybody got a piece of software to split an MP3 by speaker? (or output list of times where each speaker is speaking)

I've got an audiobook with a particularly obnoxious commentator interjecting dumb things every couple of minutes and I'd like to slice those out.

I'd do it manually if it were only a couple of edits, but there are easily 150+ comments spread through 6 hrs of material. Should be easy for a speech recognizer, just two voices with different genders.