I agree that in practise, deep learning tend to perform very well. With that said, it is not without limitations. In general, model-based machine learning approaches do not perform as well, but we should not limit our assessment only to performance.

For example in this review: https://arxiv.org/pdf/1605.01138.pdf, a model-based approach is compared against a deep learning approach. It is very interesting to me that even if deep learning performs better, its failure cases are very different than human failure cases (deep learning is not sensitive to "physics illusions"). Whereas the model-based approach is very much in-line with human performance characteristics. Also, on this task (physical scene understanding), deep learning generalises very poorly.