TV might be more entertaining, but I've never heard anyone argue "Why would you sit down and watch the new Game of Thrones episode, you should listen to a podcast instead!" Being an audio-only medium makes them a lot more amenable to consuming while you do something else. They're only competing with music and audiobooks in that respect.
It's not like I get home from work and think "You know what I want to do this evening? Sit in a chair and listen to podcasts for an hour."