It only seems to apply to high-traffic podcasts. The one I notice it regularly in is a podcast called 'Lorehammer', where at the start and end of the episodes Spotify has inserted a location-specific advert (lately Australian Police recruitment ads for some reason). These seem to be baked into the audio file as they can be skipped through with the fast forward button.

I understand people who listen to Joe Rogan hear these a lot too