That's a situation we already face. There's a line of humans who can only reproduce with IVF.
My wife and I might well have babies via IVF because she can't get pregnant while on chemotherapy - but that doesn't mean we carry any infertility genes. She just had the bad luck to have some cells mutate into cancer.