Yea sounds like it, I took the standard math track at my college and never had any problem with my upper level physics courses but most of my fellow students constantly complained their lack of math understanding was severely hurting their physics education.

I wonder if most physics curriculum's underestimate the amount of time it takes to truly become competent with calculus/DE tools. I may of only escaped because I loved math and did a lot of self study out of pleasure.