This might be clumsy but I will say it anyway. If music is math, how do you explain people who have innate musical abilities without formal academic training in notation, music theory, circle of fifths, etc.
To further underline the point: entire cultures' musical traditions don't follow the circle of fifths, or notation as you're likely familiar with it, or even notes that follow the kinds of ratios you might use to describe western musical scales of any kind. The mathematical representations of western music were applied in retrospect, math never played any role in the development of western music anyway.
So considering math was never a factor in the development of western music and the math used to describe western music doesn't even apply universally, i just can't really consider "music is math" to be a meaningful statement at all
2,000 year old Chinese music uses sanfen sunyi. You take a pipe length, cut it by a third, then extend the new one by a third, alternating. Hey look.....a petatonic scale.
Arabic music pitches even more. The maqam system uses intervals that fall between Western half steps, often called "quarter tones," Some used "commas" which divide the whole tone into 9 parts. This gives you octave with about 53 steps.