This is one of many reasons to avoid rsync for "backups" and instead use an actual backup tool.