There are some billionaires who inherited their money. There are some who lucked out with investments. Your last statement makes no sense. What sets them apart from the rest of the population definitely does involve their "wonderful qualities".
Sure, luck plays a big role in things. It takes a combination of other things too: hard work, an unwillingness to settle for "meh, good enough", an ability to convince other people (employees, investors) to believe in you and the ability to know your own weaknesses and bring in people to solve those weaknesses. Let's not just lump these all into the "and the rest" category.