Unless you're running it with additional configuration (e.g. the -g option), I don't think ntpd will save you from any bit flips other than the 10 least significant: You'll be outside the 1000s panic threshold.
I'm not sure if this rogue bit can be used to attack TOTP. Can anyone clarify?