Stats is maybe the area of math where non-math (formulas, calculations, derivations) reasoning is the most important:
- Have I unwittingly introduced a bias? Is there a selection taking place that I didn't think about when collecting the data? (Eg calling people on landlines to get polling data.)
- Is there a reason why I should expect the dynamics in the dataset occur in the future, or a reason to expect it to be gone? (Eg does the financial market work like it did before the year 2000?)
- If such-and-such hypothesis is true, what else should I be able to find in the data? (Eg suppose crime is caused by non-aborted kids, what other effects should there be? More truancy in schools?)