---
title: FACTS About Building Retrieval Augmented Generation-based Chatbots
url: https://www.ml-quant.com/papers/arxiv/2407.07858/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-09-26
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: arXiv:2407.07858
source_url: https://arxiv.org/abs/2407.07858
featured: 2024-07-17
citations: 37
topic: LLMs & Text
---


# FACTS About Building Retrieval Augmented Generation-based Chatbots

The article introduces the FACTS framework for developing Retrieval Augmented Generation (RAG)-based chatbots, and presents empirical results on the balance between accuracy and latency in large and small LLMs.

- Source: https://arxiv.org/abs/2407.07858
- Identifier: arXiv:2407.07858
- Released: 2024-07-10
- First featured: Quant Letter No. 57 (2024-07-17): https://www.ml-quant.com/issues/2024-07-17/
- Citations (Semantic Scholar): 37
- Published in: not yet
- Topic: LLMs & Text

## Related

- [RAFT: Adapting Language Model to Domain Specific RAG](https://www.ml-quant.com/papers/arxiv/2403.10131/): Retrieval Augmented FineTuning (RAFT) is a new training method that enhances large language models' ability to answer domain-specific questions by training them to ignore irrelevant documents and cite relevant ones.
- [ChatQA 2: Bridging the Gap to Proprietary LLMs in Long Context and RAG Capabilities](https://www.ml-quant.com/papers/arxiv/2407.14482/): Bridging the Gap: ChatQA 2 is a model that improves long-context understanding and retrieval-augmented generation, matching the accuracy of top proprietary models.
- [KnowPO: Knowledge-aware Preference Optimization for Controllable Knowledge Selection in Retrieval-Augmented Language Models](https://www.ml-quant.com/papers/arxiv/2408.03297/): The study introduces a Knowledge-aware Preference Optimization method to improve large language models' knowledge selection, showing enhanced performance in managing knowledge conflicts and robust generalization across different datasets.
- [RAG-IT: Retrieval-Augmented Instruction Tuning for Automated Financial Analysis - A Case Study for the Semiconductor Sector](https://www.ml-quant.com/papers/arxiv/2412.08179/): The study introduces a new method for automating earnings reports analysis using Large Language Models, with promising initial findings.
- [Retrieval Augmented Generation for Topic Modeling in Organizational Research: An Introduction with Empirical Demonstration](https://www.ml-quant.com/papers/arxiv/2502.20963/): The article presents Agentic RAG, a new method for topic modeling with large language models, offering a more efficient and reliable alternative for AI-based qualitative research.
- [Scaling LLM Test-Time Compute Optimally can be More Effective than Scaling Model Parameters](https://www.ml-quant.com/papers/arxiv/2408.03314/): The research investigates enhancing Large Language Models' (LLMs) performance using more test-time computation, suggesting a compute-optimal scaling strategy based on prompt difficulty.