Mathematics > Physics > Chemistry > Biology > Physiology > Medicine
Discoveries in mathematics are truths about the universe. They are deeper than particle physics in some respects. Some parts of mathematics might seem abstract but every mathematical system uses the naturals in its axioms or representation. The naturals are directly based on counting, based on the nature of macroscopic objects in our universe. The universe enforces rules, and the facts about naturals, and systems built upon them, are truths that directly point at the nature of information and complexity in our universe.
Why should mathematicians apologize? Hardy was wrong, mathematics can lead to nukes. But its the base level of truth, there is no other scientific discipline that discerns the patterns of the most abstract physicality - objects, and gleans truths, rules for how objects interact.
Solving the Riemann Hypothesis or other conjectures that aren't even known yet might lead to understandings/models that allow for time machines. It's impossible to know.
But why not seek to understand the universes' laws at its most generic level. Its enlightening. Spiritual. Awakening.