But realistically salary budgets are in-fact a zero sum game.

Departments have a budget. If someone else is unfairly getting paid more, it definitely means that you will be getting paid less.