I should have said philosophy instead of religion in my comment. You're right, there isn't a perfect line between physics and philosophy (cf. the whole debate on whether string theory is science). When theories about the universe are no longer testable (pure mathematical speculation), there's not much to distinguish physics from philosophy-with-equations. But all of our theories about the universe up to the limit of reasonable certainty I would consider physics.