I take it you aren't programming business CRUD apps? I almost never have to do any math. It would be a delight if I did.
But when doing the more boring CRUD stuff I historically have gotten my math kicks out of playing with functional languages. I got into Haskell pretty early because I liked the idea that the type system felt pretty mathy.