The logic of reparations does not require poverty on the part of the victim.
It requires acknowledgement of an injustice, and a requirement that the perpetrator has to make good on it. In the case of blacks we have forcible capture, slavery, a variety of discriminatory laws and policies, lynchings, and so on. There is no shortage of historical wrongs done to blacks that were never meaningfully made up for.
So far, so good. However the logic runs into some major problems. First of all, what are the rights of current blacks to reparations due to the wrongs done to their ancestors? Second, how do we identify the perpetrators who need to owe repayment? Third, is it fair to punish those descendants now for the actions of ancestors that they do not know? And fourth, what reparation would be sufficient?
My personal position is as follows.
First, if we extend to one group reparations for wrong past, we have to extend this to all groups. That way lays insanity. I'm half Irish. My ancestors were targeted by the KKK for being Catholic, targeted by the English over centuries for being Irish, and escaped to the USA from an entirely preventable famine. Every ethnic group can rehearse its own story of victimhood, and the act of doing so primarily harms those groups again.
Second, identifying perpetrators is hard. For example American blacks are more likely to be descended from slaveholders than the average white American. I grew up in poverty and there were no slaveholders in my ancestors for at least the last 200 years. I don't think it is fair to ask me to pay for the crimes of other people's ancestors.
Third, holding people accountable for the actions of their ancestors crosses the line into collective punishment. Collective punishments of all kinds are considered human rights violations, no matter how strong the rationale. See https://ihl-databases.icrc.org/en/customary-ihl/v2/rule103 for a list.
Fourth, no one-time cash reparation can make up for the ongoing problems that we continue to inflict on black communities. Therefore rather than focusing on the justices or injustices of such reparations we should focus on fixing what we continue to do wrong in the present. Of which, unfortunately, there is no shortage.