For probability, "Probability Demystified" is a good basic intro.
For statistics, I would really recommend Allen Downey's Think Stats (http://greenteapress.com/thinkstats2/index.html), especially if you're coming from a programming background. Most introductions to statistics focus heavily on the mathematics needed to enable certain analytical approximations to difficult probabilistic calculations (e.g. the t-test), whereas Think Stats just bites that bullet and focuses on simulation / brute force so you can spend more time on the actual fundamental theory behind statistics.
Brian Blais' "Statistical Inference for Everyone" (http://web.bryant.edu/~bblais/statistical-inference-for-ever...) also looks really good, but haven't had a chance to review it in depth.
If you prefer textbooks, I have heard good things about "Linear Algebra Done Right," [1] but I would not recommend it unless you are "math literate" at an undergraduate level already.
http://ocw.mit.edu/courses/mathematics/18-06-linear-algebra-...