Even if phrenology had worked most of the time, it would still be a terrible idea. Even if phrenologists could classify criminals with 99% accuracy from the shape of their skull, they'd still be screwing over a ton innocent people when their methods were applied to large populations. Putting somebody in prison because of the shape of their skull is a terrible proposition, even if you get it right more often than not.
Edit: I’m basing on a premise that working with a lot of subjects, a human inevitably creates a structure in their brain similar to what we discuss (professional deformation is a thing). I bet that it’s often even worse than $subj because a human mind tends to simplify its job for energy consumption reasons.
Even if the accuracy and error rate surpass humans, every death due to an AV failing is one death too much. However, most people seem to be happy with a failure rate lower then my grandma...
What you are arguing is that voice and face recognition are to be accepted as absolute fact, which is not how they ought to be treated. They shouldn't be considered any more reliable than a human, and any use otherwise should be discouraged. Don't throw the proverbial baby out with the bathwater.