You only save the changes that improve the loss values no? Those are the survivors whose progeny go on to the next iteration.