Armstrong literally did not believe in physical excercise though. He thought the human heart had a fixed number of beats and didn't want to "waste" them. Look it up. They guys really did not care about physical fitness back then.
Maybe he was just naturally fit. Some people are. But he was undoubtedly fit.