Machine learningML & AI Methods
Depthwise Hyperparameter Transfer in Residual Networks: Dynamics and Scaling Limit
A new method for hyperparameter tuning in deep learning has been proposed, using residual networks and a specific parameterization for optimal hyperparameter transfer across network width and depth.
Featured in No. 29 on 13 Dec 2023 · · 69 citations today · published in International Conference on Learning Representations
- Released
- 28 Sep 2023
- First featured
- No. 29 · 13 Dec 2023
- Citations (Semantic Scholar)
- 69
- Influential citations
- 7
- Published in
- International Conference on Learning Representations
- Shares when featured
- 106
- Identifier
- arXiv:2309.16620
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).