It likes to lower the training loss, you could say this is what made it what it is.