One thing that's difficult about math is all the "mathematical maturity" required, much of which is notation and... abuse of notation.
Math seems like an Arts subject, where you must learn all the cultural background, as in English Literature. I'm not sure it's necessary, given it's not logical nor self-contained, but is arbitary and historical. Then again, I'm not absolutely convinced it's not necessary...