Machine learningML & AI Methods
Tensor Programs VI: Feature Learning in Infinite-Depth Neural Networks
Deep Residual Network Feature Learning: The research explores depthwise parametrizations in deep residual networks, pinpointing Depth-$\mu$P as the best parametrization for maximizing feature learning and diversity, but notes its limitations in deeper networks.
Featured in No. 21 on 16 Oct 2023 · 13 days after release · 103 citations today · published in International Conference on Learning Representations
- Released
- 3 Oct 2023
- First featured
- No. 21 · 16 Oct 2023
- Citations (Semantic Scholar)
- 103
- Influential citations
- 11
- Published in
- International Conference on Learning Representations
- Shares when featured
- 53
- Identifier
- arXiv:2310.02244
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).