I suppose "time away" would work, but that's basically what we mean by "leave" as well. What got my dander up was the implication that me taking leave to be with my spouse and infant child (which I did not get the opportunity to do) is the same as vacation time.