While I totally understand his point about excessive intervention, ignorance is not the answer. You absolutely can say "no" to doctors.
Of course, with tests that are of themselves dangerous, that's another issue. Skip those if the risk/reward is too high.
Getting diagnosed too late is much worse than having to say no.