The article implies throughout that audiences are shrinking but the only mechanism for that is Apple Podcasts won't download episodes for a user who isn't listening anyway.
It is possible that overall podcast listening is still up yoy. It is also possible that even if the top podcasts decline (which the article sorta hints at?) that it may just be because the market is now saturated with thousands of competitors that each take a very small slice.