Is there an accompanying paper out there?
> (an) author here: paper will likely be coming out in O(month)
Ug. I'm adding "O(month)" to my list of bootless metaphors.
Why? (1) Because in Big-O notation, O(month) would equal O(day), which is not the intended meaning in the comment above; (2) It is non-sensical; one would never say e.g. "the run-time of an algorithm is O(seconds)" -- we write some kind of input inside the parens, not the output
Anyhow, we already have the words roughly and about; e.g. "about a month".
Feel free to call me pedantic, but words matter.
Stochastic Weight Averaging (Izmailov et al 2018) https://arxiv.org/abs/1803.05407
Latest Weight Averaging (Kaddour 2022) https://arxiv.org/abs/2209.14981
Latest Weight Averaging? (Sanyal et al 2023) https://arxiv.org/abs/2311.16294
Cyclic Learning Rates (Portes et al 2022) https://arxiv.org/abs/2206.00832
Exponential Moving Average? (Zhanghan? et al 2019) https://arxiv.org/abs/1909.01804