If you put a password on the Authy backup then it cannot be restored without that.

https://support.twilio.com/hc/en-us/articles/223182508-Authy...

This should be the default really.