that example of the radiologist review cases touches on one worry i have about automation with human-in-the-loop for safety. specifically that a human in the loop wont work as a safeguard unless they are meaningfully engaged beyond being a simple reviewer.

how do you sustain attention and thoughtfully review radiological scans when 99% of the time you agree with the automated assessment? i'm pretty sure that no matter how well trained the doctor is they will end up just spamming "LGTM" after a while.