"Physics is mathematical not because we know so much about the physical world, but because we know so little; it is only its mathematical properties that we can discover."
Math isn't behind everything, and not everything can be explained with math. But it happens that the things that are mathematical turn out to also be quite useful.