For me it's the questions. He gets these incredible guests with deep understanding of their respective fields and yet they keep being asked nonsensical question they can't possible give a meaningful answer to.
For example almost every guest some variation of "Do you think one day we'll have superhuman AI?" Then the guest is struggling to come up with some platitude, because there is nothing else to say. It's a waste of time.
He is self-aware too, he sometimes apologizes for asking, yet he keeps doing it anyway.