Machine learningLLMs & Text
On the Effect of (Near) Duplicate Subwords in Language Modelling
The research examines the effect of near duplicate subwords on language model training, revealing that while duplication hinders efficiency, merging similar duplicates can also harm performance.
Featured in No. 58 on 24 Jul 2024 · · 6 citations today · published in Annual Meeting of the Association for Computational Linguistics
- Released
- 9 Apr 2024
- First featured
- No. 58 · 24 Jul 2024
- Citations (Semantic Scholar)
- 6
- Influential citations
- 1
- Published in
- Annual Meeting of the Association for Computational Linguistics
- Shares when featured
- 71
- Identifier
- arXiv:2404.06508
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).