Slave societies are generally poor. Africa's economy was largely slave-based until relatively recently (and still is the only place where you have active slave markets, the reason why slaves came from Africa was because it was the only place where there was a local slave industry, largely due to the trade into the Middle East), Brazil's slave trade was 10x larger than the US (the US never actually had a large first-generation slave population because mortality was so low and fertility so high), Caribbean the same, the Middle East the same, India the same.
There is a lot of research on this subject but it is worth remembering that slaves were capital that had a price too. So it wasn't "free labour" in any sense.
Most plantation owners didn't end up rich either, there were economies of scale and the price of cotton collapsed over the 19th century.
Over the long-term though, slave labour has typically inhibited economic development.