If you have a hammer, everything looks like a nail. Medicine isn't a good nail to hammer with a LLM, though. I struggle to see how a stochastic token completion system, prone to hallucination, let alone all the attack vectors described over the last months and years, would do any good in the medical domain.

A medical paper isn't just a digestible blog post or conversational op-ed, it's full of technical jargon and statistics that even require expert readers to do some unpacking in order to evaluate how the presented findings fit into a larger picture. Indeed, it's a skill and often a form of art to be able to read and understand medical papers, even from within one's field of expertise. Aside from that, medical knowledge is never truly established, it is always in flux, both in respect to ongoing research and in the skill that derives from decade long practice of negotiating this with often more complex and nuanced real-world situations, i.e. with the patients that come through the doctor's office doors.

Doctors already face(d) the toll of diagnosis within a Google search's reach: misinformed, anxious and often outright overconfident patients often stand in their own way. That is not to say, that medical literacy and knowledge for the masses would be a detrimental thing, quite the contrary is true. However, with the high stakes faced in medicine, any misinformation, be it by Google or LLM can lead to grave harms.