Machine learningML & AI Methods
SOAP: Improving and Stabilizing Shampoo using Adam
A new algorithm, SOAP, enhances the computational efficiency of the Shampoo preconditioning method in deep learning tasks, reducing iterations and time, with an online implementation available.
Featured in No. 84 on 5 Feb 2025 · · 223 citations today
- Released
- 17 Sep 2024
- First featured
- No. 84 · 5 Feb 2025
- Citations (Semantic Scholar)
- 223
- Influential citations
- 40
- Published in
- Not yet, as far as Semantic Scholar knows
- Shares when featured
- 197
- Identifier
- arXiv:2409.11321
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).