Statistical analysis approach can be a good educated guess at most. But if we keep observing human brain to get input/ouput dataset, we can develop a field that much like Physics, where the theory comes from experiments and even those do not must need future experimental proof to be considered valid. Yes, not all these theory based on expriments is true (that is why I say it is a good educated guess) because maybe our observed set is just a subset of all test cases we need. But using this approach like Physics we can keep pushing the limit of (AI) theory and expriements forward.

As I mentioned another half (theory first, then experimental validation) of this approach is another Einstein came along and made amazing thoeries once and for all. Then the expriments proves it is true to our best knowledge up to date. The the loop starts again.

I think the first cases may be the most prevalent because insights are not very easy to come by without seeing experimental result first. If we can make a organized way to keep working on the first half, the second half might come by some time. Just some random thoughts, primarily made to inspire some followup conversations amongst us.