For linear algebra, I was suggest Strang's "Linear Algebra with applications", 3rd edition. Then "Linear Algebra Done Right".
While you are at it, get Hungerfords "Abstract Algebra: An Introduction"; you will need an easy reference to fields and groups and polynomials.
All these books require an hour per page, but they lay it all out for you if you work for it. These are definitely undergrad books, but that is their beauty.
Bartle also has "Elements of integration and lebesgue measure" -- I bet it is great, but I haven't used it.
And if you find a good probability book, please post the title ;)