I had exactly this reaction to Malcolm gladwell. It is completely obvious that gladwell across multiple books has never once read one of his references and consistently misrepresents what they say.
As he's shifted from primarily a journalist to primarily a storyteller, he's chosen to sacrifice additional information and accuracy in lieu of telling a consistent and compelling narrative that support what he thinks is the important thing to take away, not necessarily what you would take away were you to review all the same information yourself.
Under that understanding, I find him fun to listen to. The things he "reports" on/illuminates are interesting, but at this point I don't assume he's giving them an even handed representation, so his conclusions are not necessarily my own, and at best it's a set of things to look into and research myself if I find my interest piqued after a fun or interesting story is told.
If the best evidence that Gladwell could find to support his points, don't support his points, then it really makes me question the utility of trying to find evidence to support Gladwell's points.
It may be that, the reason why no subject matter expert makes the points that Gladwell does is because Gladwell's points are either wrong or not even wrong.
On the other hand if you see Gladwell for what I think he is, which is an entertaining storyteller using science as a backdrop to present his view of the world, and willing to twist it to suit his view, then he's really no different than many other writers. In that case you can enjoy him or not, at your leisure, just as you would any other editorial or op-ed piece. Entertainment is entertainment, and his content is entertaining even if I don't expect it to be true (to be clear, I'm approaching this as someone that mostly consumes his podcasts, which some chapters of his books have been directly converted to. I wouldn't want to spend the time reading this content that's not true, but I'm happy to listen to it while on a drive).
Whether he's causing more harm than good overall to the public is another question, but honestly that's a much bigger discussion with a lot of much bigger problems than him, so I'm not sure it's worth getting worked up over.
Stories/memes/narratives are the most easy/potent form of mental ingestion - so much so that I think humans cannot ingest facts or ideas at all, only stories. And this puts a collective responsibility on all of us to be very careful about the stories we create.