Solomonoff Induction. Although proven to be uncomputable (there are people working on formalizing efficient approximations) it is such a mind-blowing idea. It brings together Occam's razor, Epicurus' Principle of multiple explanations, Bayes' theorem, Algorithmic Information Theory and Universal Turing machines in a theory of universal induction. The mathematical proof and details are way above my head but I cannot help but feel like it is very underrated.