I've often seen "An introduction to statistical learning" [1] and "Elements of statistical learning" [2] cited as good resources for statistical inference and machine learning. The former is more of an undergrad text, while the latter seems to be aimed at graduate students. Both books are available free online.

[1]: http://www-bcf.usc.edu/~gareth/ISL/ [2]: http://statweb.stanford.edu/~tibs/ElemStatLearn/