It's not so surprising. This could also be summarized as "God created the integers."
But really the process is reversed: given arithmetic, what is the smallest axiom set to give us the power to prove our theorems.
It's like, given all code, what is the smallest language we can use to express it. Which is sequences of 0s and 1s.