Machine learningOther
Adam with model exponential moving average is effective for nonconvex optimization
The article analyzes the optimal convergence rates of two optimization techniques, Adam and model exponential moving average (EMA), in different nonconvex optimization settings.
Featured in No. 72 on 31 Oct 2024 · · 36 citations today · published in Neural Information Processing Systems
- Released
- 28 May 2024
- First featured
- No. 72 · 31 Oct 2024
- Citations (Semantic Scholar)
- 36
- Influential citations
- 10
- Published in
- Neural Information Processing Systems
- Shares when featured
- 36
- Identifier
- arXiv:2405.18199
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).