The math is hard.
Same deal in calculus. Conceptually very easy, you can determine the total by adding up the amount in the slices. Calculus is easy, algebra is hard.
For anyone out there beginning their journey reading this, there is nothing I would recommend more than this: do the work; chew the pencil; become very good at algebra.
More science education than science the philosophical pursuit. Which was more the concern of the folks I was tutoring.
Ironically I actually did really well in multivariable calculus in college. I had tremendous trouble focusing on anything I didn't find interesting, but once I recognized that all the computer graphics papers I was reading at the time were all based in multivariable calculus and differential equations I was hooked.
Early on, studying Newtons laws, the concepts are way easier than the math for most people. Inertia, parabolas, friction, angles.. we can see it and use it every day.
But the current state of knowledge is that we can reliably use math to calculate phenomena that seem to have no analog in the familiar concepts that govern our everyday experience. The math of dark matter is fairly straightforward but the concept is so weird that tons of people reject it out of hand (as seen in the comments whenever it comes up on HN).