A Plea to the Labs: Let the Models Diagnose

tangent.bearblog.dev

2 pointsstalfie3 comments

I got so frustrated with Fable refusing to make any medical diagnoses, which is the most recent iteration of a longer trend that has bothered me for years, that I made a blog to express how annoyed I am.

Posting it here in case anyone is interested in a non-coding perspective on model refusal behaviour.

And because I really want someone at anthropic to read this so I can test the goddamn thing.

I agree, but even if you click on the big red button to enable the unsafe mode, if you follow any stupid medical advice of the chatbot and die, your family will sue Anthropic and the press will be angry with Anthropic.

Well, the Fable guardrails breaks this argument, as when you get booted down to Opus 4.8 it still happily responds (as does most other models after a "I'm not a doctor but..." hedge).

So you get to press the big red button anyways, you just get downgraded to stupider advice, increasing the risk of catastrophy and lawsuits.

But the whole point is that the models are so good now anyways that any stupidity will most likely be from the user misunderstanding the output...which already happens all the time with humans.

Reply on news.ycombinator.com