We tend to prefer simpler theories that still manage to make good predictions. Is it really a surprise that our best theories are simple in light of our aesthetic preferences? The "true laws of physics" could be god-awful, and we could find ourselves in a universe where we're literally incapable of knowing that due to practical constraints. It's also not surprising at all that theories that are aesthetically-pleasing to us manage to have multiple different mathematical formulations -- if we're assuming from the outset that they're not very arbitrarily-defined theories, it seems perfectly natural that multiple interpretations would exist. Nature could be more horrifyingly complex than we could ever imagine, and even if that were the case, it's conceivable that all of the laws "good enough" to make testable predictions would have a nice mathematical structure. Even then, we're nowhere near the "end of physics" -- how are we supposed to know that we've not just been wading around in the shallow part of the pool, only to find a bottomless pit waiting for us just a few meters away?