I found it helpful to read through Think Stats and Think Bayes before tackling a machine learning book.

[1] Think Stats: http://www.greenteapress.com/thinkstats/thinkstats.pdf

[2] Think Bayes: http://www.greenteapress.com/thinkbayes/thinkbayes.pdf