the interesting question is: what is the barrier we need to cross to trust LLMs with stuff like this? we'll probably cross the barrier but I'd have a hard time setting a true percentage success boundary
Or, what is needed before we are forced to give LLMs control of life or death decisions in the name of profits?
It is simply not possible to identify mushrooms from image alone, no matter how good your LLM is.
Not trusting my life to an “intelligence” that has nothing to lose.
If the only reason you give advice is predicated on the transactional value of that action, I think you've given up on acting ethically.
While to some extent we all are motivated by some abstract transactional value, I think immediately perceiving and reducing everything to a surivivalist, transactional mentality is an empty, cynical existence.
I said nothing of the sort.
Let me give a different example: I would not ride on a plane being flown remotely by a pilot on the ground. But I will ride on a plane with the pilots aboard. I do not necessarily believe the remote pilot would intentionally endanger me, but at the same time they are not facing mortal peril if they screw up. So I would need some other reason to trust them (maybe the remote pilot is a family member).
An AI has nothing to lose for misidentifying a mushroom, and I have my life to lose by trusting it. It can’t even fear for my life on my behalf.
Everything performs a particular task to the best of its ability and we all accept the level of risk we are willing to tolerate. If machines gain trust from enough sources, it will be accepted.
All I'm saying here is (if you walk back the necessity of having "skin in the game") -- all I'm saying here is, we regularly trust our lives to situations and people we expect to reasonably fulfill a given task. Most of us get in an elevator, or drive in a car, or even just buy food from a store.
I also don’t really have any other options in that regard, so there’s no real choice to make, other than getting a second opinion. I may not have a chance for a second opinion if I fully trust an AI on mushroom ID.
> Most of us get in an elevator, or drive in a car, or even just buy food from a store.
Of course, and I do too. Mostly because I have to and because there are many aspects of those risks that remain under my direct control. At times I have decided to take the stairs instead of the elevator.
So it will probably come long after airplanes actually.