I think your goal to "learn math/physics" is too broad. Steven Hawkins was still trying to learn about physics before his death.

Define what "understanding physics" means to you and then figure out how to get to your goal.