You would take those odds? 100x more deaths?
I agree that AI _companies_ should be accountable for the software they produce but I’m not convinced you would go for a 90% chance of survival if you can choose 99.9%.
But, yea, in general, it would take a huge (1000X or 10,000X) difference in expected outcome for me to trust something that is unaccountable. If the AI company was actually held accountable for its AI's mistakes, I'd definitely change my statement.
I am having a hard time imagining a future where “AI” isn’t just a tool that a given establishment decided to use much like anything else they use
Everything as much as possible, yes, and the company behind it will be an AI driven autonomous corporation as well. Although I suspect that by then there will be some industry specific AI model being used by hospitals, not just plain Claude.
AI will handle patient data, diagnostics, prescriptions, everything that doesn't absolutely require a human and can't yet be done by a robot.
Somewhere, some human will be making money but they will be far from any legal liability, probably safely ensconced in a bunker on a private island when the gravy train really hits the fan.
>I am having a hard time imagining a future where “AI” isn’t just a tool that a given establishment decided to use much like anything else they use
The people making the decisions, investing the money and writing the laws imagine so much more, though. You assume the future of AI is governed by rational people making rational decisions but it isn't, it's governed by Musk and Thiel and sociopaths and grifters and cultists who want to immanentize the eschaton so they can stand at the right hand of God.
They're inhuman(e). They hallucinate, and have devoured volumes of Harvard Business Review.
I might be naive to the core but I think, in the long run, I am not very Doom&Gloom about AI like you are sounding, people have a way of (eventually) making their own decisions and won't put up with this world you are pitching (I hope lol)
I can even see it being sold as part of healthcare reform. After all, we don't trust doctors anymore, we don't trust science, surely AI would be more fair, more rational and ethical. AI can't be paid off by big pharma to push pills you don't need. AI doesn't care what race or gender you are. AI doesn't get exhausted after a 24 hour rotation. Costs would go down, quality would go up. That would be the pitch anyway. The rest would be in the fine print, not a sign in front of the hospital.
I don't want to live in that world, but I can see a path to it from where we are now. I think some kind of legal personhood for AI as a pretense to apply legal liability to AI is inevitable.