Perhaps you should try a different teacher. I know guys who started training in their 50s and 60s, so it's entirely possible if you pace yourself, and not exceed the current limits of your body. Little by little, these limits get stretched and your physical condition improves. Of course it's easier if you're fit and flexible to begin with, but that's not a requirement.