Somewhat relevant.... I really enjoyed going through the Neural Networks From Scratch (NNFS) book/course. It goes in-depth through all the math and why it's there. I had to dig back to some college level calculus and had a ton of fun with it. I found that actually doing the integrations by hand in a notebook helped tremendously.
If you find something like that for diffusion models, don't forget to share.