I think David Hume was quite good on this subject. If chance of being right is all there is to knowledge, then maximizing your chance of being right is what knowledge is. So all the peer review, the numbers and statistics, for example, contribute to knowledge even if it might be wrong. And if you dismiss, as you do, statistics because they just might be misleading or biased, and are thus not "objective reality fact", that does damage to your ability to know things, because you are discarding data without considering it, and that damage should be avoided. Whereas the proper thing to do is consider it on merits, whatever the actual merits are.