Physics has not "one of the better reproducibility rates" but 100%; per the Scientific Method any valid theory must:
- be reproducible (verifiable empirically)
- have predictive power
- not negate existing theories
This constitutes 'acceptable proof'.
It yields a 'compound effect' to theoretical research: for instance, Newton's Laws were never wrong, just narrower in scope than Einstein's. No future valid theory will ever prove any of these two wrong, it can only generalize more, because we know these two to be true. True is true forever, barring a fundamental change in this universe itself. So we keep the theoretical foundations forever, they're solid.
Their interpretation, however, may change as we widen the scope, and that is the 'human' part in science, the art of it, to produce valid representations linking the math with the experience of reality. That changes a lot, in time, and even from person to person.
The 'why' things are is another matter entirely and not a concern for physics nor science in general; we search for the root causes to explain 'how' things work the way they do. We stop there in theory for beyond is mere interpretation, opinion, belief.
Now this would exclude all social sciences and biology and countless others from the realm of 'science' and that's not fair; these fields yield very usable results despite the nigh impossible search for pure theory. I like the 19-20th century view that 'empirical sciences' gain value when we try to the best of our ability to apply the Scientific Method and mathematical tools to account for fuzziness.
Deep learning is certainly a formidable upgrade to the tooling of empirical sciences, brute-forcing 'how' things work for lack of a better truth than retrospective.
Just don't compare it to e.g. physics, don't ask for predictability (as you wouldn't ask a fish to fly), it's pointless and only serves to undermine the value of empirical sciences, while overemphasizing that of theory.
Because you know, in theory, practice and theory are the same, but in practice they're not... ¯\_(ツ)_/¯