We won't get it if we never bother to look for it.
I'm not arguing for cruelty. These articles make the front page of HN precisely because our current approach is so broken that people find the results horrifying.
But active diagnoses, treatment attempts, and tracking of patient responsiveness, are indispensable to medical research.
And it took less than a minute to Google up an overview of recent research progress along many avenues for cluster headaches, as an example:
https://www.bmj.com/content/376/bmj-2020-059577.long
I think you can stop worrying that medicine has to make dire choices between best treatment efforts today vs. finding better treatments for tomorrow.