Machine learningLLMs & Text
Nearest Neighbor Speculative Decoding for LLM Generation and Attribution
The paper introduces Nearest Neighbor Speculative Decoding, a language modeling approach that improves generation quality and speed by incorporating real-world text spans into language model generations.
Featured in No. 52 on 5 Jun 2024 · 7 days after release · 28 citations today · published in Neural Information Processing Systems
- Released
- 29 May 2024
- First featured
- No. 52 · 5 Jun 2024
- Citations (Semantic Scholar)
- 28
- Influential citations
- 4
- Published in
- Neural Information Processing Systems
- Shares when featured
- 59
- Identifier
- arXiv:2405.19325
Citations and venue from Semantic Scholar (ODC-BY), refreshed weekly. Summary: Quant Letter (CC BY 4.0).