He's pretty fit - I think he's just way smarter than average and able to pair that with extreme focus (rare). It comes across in Masters of Doom.
There’s also a lot of other commentary on his capabilities outside of that one account, so it seems likely to be true imo.