Show HN: AdaBound, an optimizer that trains as fast as Adam and as good as SGD

Are algos like Adam being used besides deep learning? I always come across Levenberg-Marquardt and Gauss-Newton, but never Adam.

Reddit thread by author : https://www.reddit.com/r/MachineLearning/comments/auvj3q/r_a...

Is there a nice resource where I can read about all these different optimizers, their details, as well as a comparison between them?

Looks like a nice incremental improvement. Still waiting on TensorFlow though.