Imagine trying to equate an innate or irrelevant property like one's skin color or sexual orientation with one like "posesses billions of dollars somehow"
The whole reason the article focusses on Buffet is to explore exactly your worry that there might be any such thing as a mixed group of varying innocence being painted with a single brush unfairly.
Pick the best possible example and judge, does the best known example of a billionaire validate the idea of billionaires? And at least this analysis decides no it does not. You may argue that this analysis is in error but I'm addressing your question about the right to do the analysis at all.
Billionaires are artificial constructs. The entire class can be judged and un-created with no moral problem at all. One's billionair-ism isn't like one's atheism or albinism. We can decide any time we want that no such thing as a billionaire should be possible, and make it so.