I believe the math background is quite important in ML, and having a good understanding of it from the beginning helps tremendously. You can check my answer from before here: https://news.ycombinator.com/item?id=36477464