I use the skip silence in the android app Podcast Addict. https://play.google.com/store/apps/details?id=com.bambuna.po...

I certainly don't notice it easily but I have saved several hundred hours according to it.