I'm guessing the author hasn't a maths education beyond high school.
That being said, I think it's a great course, and would highly recommend it to anyone who thinks they're up for it. But there are other courses that provides an easier gateway into ML.
I had the same experience, even after using Matlab some in grad school. I wish I had seen this before trying Ng's course (all of the exercises in Python):
http://www.johnwittenauer.net/machine-learning-exercises-in-...
So much quicker / easier to follow, at least for me.