Hopefully you are a proper software shop and you do more than just run test suites to see if something is working :)

And if you discover that "hey, changing X broke Y but we didn't catch it before", then obviously you rollback the change and start working towards how you can prevent it in the future.

Of course there will always be fuckups, but this strategy wouldn't make it harder/easier to rollback those changes.