You only save the changes that improve the loss values no? Those are the survivors whose progeny go on to the next iteration.

Something like a GAN is closer to what we'd consider evolution.