True, that is why I used the words "Discover/Invent". Also i used physical structures as an example since they are the most visible and unarguable evidence of "Real" Mathematics from the earliest times.
You can invent abstractions to model concrete things(eg. all that is needed to model a skyscraper) or to model still further abstractions in a chain (eg. vector spaces for multidimensional/functional/etc. spaces). We only realize that it is "Real" when it is "Applied" in the concrete World (eg. number theory in cryptography).
>where all this perpetually undiscovered math is confined in the universe
It is in the very fabric/structure of the Universe itself Eg. Calculus buried in the motion of planets around the Sun and discovered by Newton.
But how much of our math is just a poor approximation of our universe? Like Newton's gravity was.
If our math only _approximates_ the world, if we discovered something that explains things better, it would all be irrelevant.
There are a lot of hints that something big is missing in our maths as a means of explanation. Like the mathematical constants Pi and Euler repeating infinitely, quantum randomness...