The branches you rebase most of the time are your own topic branches, where you know what's going on. And they should be relatively short-lived.