It is assuming victimhood, because it is presumed immoral (or illegal) activity for what could at least as reasonably be totally moral and legal decisionmaking as a result of other factors.
If you choose not to work as much as someone else or made choices that require higher compensation, it is not an "-ism" for your employer to choose another candidate on that basis alone. We're going down a dark road claiming victimhood without evidence as quickly as people are.