Fairness isn't an end in itself, but unfairness can cause people to revolt, which then leads to more suffering.

It's just a matter of how you weigh such considerations: https://www.utilitarianism.net/types-of-utilitarianism