I did a BeMyEyes test recently, trying to sort about 40 cans according to the existance of a deposit logo. After 90 minutes of submitting photos, and a second round to make sure it doesn't lie too much, I had 16 cans which according to BeMyEyes (OpenAI) had a deposit logo. Then, I went to the shop to bring them back. Turns out, only 4 cans had a logo. So after a second round to eliminate hallucinations, the success rate was only 25%.
Do you call that reliable?
But isn't the BeMyEyes assisting happening via other humans? I remember signing up for some "when blind people need your help" thing via BeMyEyes and I understood it as it's 100% humans on the other end of the call that will help you.
However, somewhere around 1 or 2 years ago, they added a OpenAI vision model based way to send in photos and have them described.
In general, its a very nice feature, if it works. For instance, I do use it successfully to sort laundry.
But the deposit logo test I did gave horrible results...