You may reuse some concepts I have described for an audio adblock: https://www.adblockradio.com/blog/2018/11/15/designing-audio...

More precisely, audio spectral preprocessing then neural network such as LSTM.