Pick a book, pick a pace to work through it, and spend a few months going through it. Do the exercises in the back of each chapter, work through the solutions, and ask around if you still can't figure it out. Persistance and routine are key here.
As for books, I like Stewart's Calculus, Lay's Linear Algebra, and Hammack's Book of Proof.
For physics, I don't know what your background is. Giancoli is a popular undergrad freshman year book, where as griffith's electrodynamics is a bit more advanced.