This is actually a really good point, but unfortunately this is actually how public education through high school tried to teach math. I remember the agony I experienced as a 3rd grader for not being able to memorize "multiplication tables". Instead I took the approach of trying to understand what the mathematical meaning of multiplication is. This was to my extreme academic & mental detriment as we were not graded on understanding, but instead graded on how fast we could answer math questions.
I felt like a total failure. It's much faster to memorize vast multiplication tables and recall them from memory than trying to understand first principles.
Obviously, my concern over this was totally pointless as I've never been in a career environment where I was told "just memorize the answer, don't bother trying to understand anything".