If there is not a human-explainable reason a model has made a prediction - and it's just a statistical blob in multi-dimensional feature space (which we cannot introspect) perceived improvement over humans is simply overfitting. It will be extremely good at finding the median issue, or following a decision tree in a more exacting way than a human. What a human can do is expand the degrees of freedom of their internal model at-will, integrate out of sample data, and have a natural human-bias to the individual at the expense of the median. I'd rather have that...