Why does "pay disparity" or income inequality matter?

Suppose two people start at 10. One person finds a way to go to 20 and the other goes to 11. The inequality has increased and the wealth of both people has increased.

Technically, this is a social improvement. But egalitarians would say this is a terrible situation because the gap has gone from 0 to 9.