Top New Best Ask Show Jobs

Introducing the Sophia optimizer, a faster alternative to AdamW | Hacker News Reader

Introducing the Sophia optimizer, a faster alternative to AdamW

twitter.com

16 points·m00x··4 comments

Open articleView on HN

Paper: https://arxiv.org/pdf/2305.14342.pdf

Code: https://github.com/Liuhong99/Sophia

Unofficial implementation: https://github.com/kyegomez/Sophia

Looking forward to trying it out this week

Ignore that link. Their implementation doesn't even run and seems to be almosy entirely chatgpt-generated.

Reply on news.ycombinator.com