Machine learningML & AI Methods
An Image is Worth More Than 16x16 Patches: Exploring Transformers on Individual Pixels
A study shows that vanilla Transformers can treat each pixel as a token and still perform well, questioning the need for locality in computer vision architectures and suggesting a new direction for future designs.
Featured in No. 54 on 20 Jun 2024 · 7 days after release · 75 citations today · published in International Conference on Learning Representations
- Released
- 13 Jun 2024
- First featured
- No. 54 · 20 Jun 2024
- Citations (Semantic Scholar)
- 75
- Influential citations
- 2
- Published in
- International Conference on Learning Representations
- Shares when featured
- 228
- Identifier
- arXiv:2406.09415
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).