I think it’s mostly a case of the drunk looking for his keys under the lamp post because that’s where the light is.
We have no idea how much there is to know about reality. We do know how to describe some parts with mathematics, but who knows how much there is out there which is not possible to describe with mathematics.
We may just be discovering infinitesimally small part ls of reality which math happens to describe well.