Looking at the Colonial era is looking at slavery ~300 years before it peaked just before the Civil War. Therefore, the numbers you give for the Colonial times don't have anything to do with the conversation.
The first user made a wild, incorrect guess, and the rest of this subthread shows just how badly that can spoil discussion quality on a forum like this. Fortunately, someone linked an earlier discussion up at the top.