To me it's not about Joe Rogan himself, but his guests. He gets great people on his show and lets them talk, and that's why I like his podcast so much. I don't listen to it because I especially like Joe (although I find him to be a rational human being), but because he has a big variety of interesting guests.
Most of the discussions on his podcasts sound healthy and sane, but sometimes he gets more wild/controversial ones which is always entertaining.
He just doesn't go to the extremes. No clickbait, no outrage, no suspicious promotions, he just feels down to earth which is refreshing in this day and age on the internet. It doesn't mean that he's always right, but he realizes this and doesn't try to push his opinions too hard.
I find that the "haters" that always criticize him are missing the point of the postcast which is to hear the guests, not Joe.