I'm sorry, but in many cases and even many important diagnoses that impact the patient, 2 radiologists that aren't allowed to communicate will sometimes reach widely different conclusions. Additionally, if you've interacted with radiologists you were certainly able to see that their analytical and logical thinking capabilities are often far below that of a CS major.
A complex problem in radiology is not: "this patient has TB because [chest X-ray]". It's more like: "take this patient that had 30+ surgeries in the past 5y and tell me if his problem is more likely to be diagnosis 1 or diagnosis 2". And the problem for those cases is that you will never reach the critical mass of training data required (within the capabilities of a single startup) because those cases are too rare. You'll need the collaboration of the health system as a whole for that, _i.e._ state policies. So you can't really chip away at the complex problems on your own.