You wouldn't have to wipe away the differences, but for some a "just" society should view someone who had poor parents, limited opportunities and an IQ of 70 and someone who had every opportunity, great parents, and an IQ of 130 as equally important and valuable. Such people view a society where the top 2% of the world owns over half the wealth and much of the world lives in absolute poverty as a sign that maybe our institutions are a bit out of wack.
Personally I'm more a fan of smaller "nudge" (nudge.org) like concepts combined with a progressive tax code and a strong commitment to helping minimize "brute luck" (being born to poor parents) while holding people fully accountable for personal decisions or "option luck" (choosing to take a risk, or making a life decision such as being a teacher vs. an i-banker; or going out at bars instead of saving). (Sort of in a Dworkin fashion see: http://en.wikipedia.org/wiki/Ronald_Dworkin#Theory_of_equali... / or http://en.wikipedia.org/wiki/Luck_egalitarianism).