Machine learningML & AI Methods
Transformers are SSMs: Generalized Models and Efficient Algorithms Through Structured State Space Duality
The research identifies a link between state-space models and Transformers in deep learning, leading to the creation of a faster language modeling architecture, Mamba-2.
Featured in No. 52 on 5 Jun 2024 · 5 days after release · 1,953 citations today · published in International Conference on Machine Learning
- Released
- 31 May 2024
- First featured
- No. 52 · 5 Jun 2024
- Citations (Semantic Scholar)
- 1,953
- Influential citations
- 324
- Published in
- International Conference on Machine Learning
- Shares when featured
- 300
- Identifier
- arXiv:2405.21060
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).