But yes, I do think people should be accountable for what they say. (I know the fun term is "cancel" but let's call it what it is, shall we?) If victims of child abuse have to be called to account, so that _he_ may be convinced, then I do not think he is a person we should hold in high regard.
The particular child abuse comment was retracted, there is nothing more to be done. You are holding him accountable for something for which he has already accounted. You are laser focused on the one wrong step.
Think of him what you will, that is your right, but brigading against someone for something said 20 years ago and later retracted is petty.(He was also arguing on the assumption that children can give consent, and that consent=> no bad outcomes.)