Maybe I just don't trust my memory (as in how am I sure that 7*8 is 56) and why I despise rote memorization and rather retain memory from use and practice.
Regardless a good example of something to remember in math is the quadratic formula Still enjoyable to derive and 'see' why it works but also just used so much. That said, I wouldn't encourage memorizing it without first understanding it.