This argument is like “what about the minors who want to date middle aged men?”
Is it possible a few want to do it? History shows us yes. Is it the likely situation? History shows us no, by an absolute long shot. The correct answer which errs on the correct side is to ban the behavior, thus saving tons legal fees and often coerced defenses.