Perhaps the optimizer is worse but the architecture or objective function is better.