Isn't this just an argument against inconvenience? I.e. "If this were true, it would make other math, etc very difficult".

The same argument could have been waged against the heliocentric model. Occam's razor is not a natural law after all.