I'd be very curious how they even define "safe enough" for this. With most therapies, the risk is mostly to the patient. Here the risk could be passed on to a future person who never consented to the experiment.
I get where you're coming from, but this seems no different from the risks associated with having a baby. Pushed further, babies never consent to any of the traits they inherit from their parents.
Same as the rest of the IVF-associated assisted reproductive technology stack. Tampering with the reproductive process is not exactly new.