I think painting this as such a clear "black&white" issue you make it much too easy for yourself. This goes particular for South Africa, where much of the wealth disparity is because of the economic divisions that were created during colonization and apartheid live on.

On a more general this is similar to the arguments with libertarians who hold property rights up the highest, ... but only from now, ignoring the blatant disregard for property rights in history which cemented todays economic structures.

I don't have good answers how to deal with wrongs of the past, but it's clearly not simple.