The majority of complaints I’ve seen have been of the sort “he says X is true and doesn’t even bother to consider that Y!”

… but he does. Like two paragraphs later. He states that specific criticism, and addresses it. Maybe not well! But that’s rarely the complaint.

I think the form of the book threw some folks who weren’t used to that sort of thing—a series of assertions and statements unbroken by digression, spanning one or more paragraphs, followed by paragraphs directly stating and addressing many criticisms a reader may have come up with.