ParentFull threadnaturalgradient·No mention of Kronecker factorization or any work on second order methods?This would be more aptly titled 'Tips and tricks for Adam'..View on HN