FinRankGRPO: Optimizing LLMs for Listwise Financial Asset Ranking via Group Relative Policy Optimization

While Large Language Models (LLMs) excel at understanding unstructured financial contexts, their direct use in portfolio optimization is limited by a mismatch between next-token prediction and the listwise ranking objectives required for asset allocation. They also struggle with precise numerical forecasting, leading to instability and arithmetic hallucinations. To bridge this gap, we propose FinRankGRPO, a framework that shifts LLM based portfolio construction from direct numerical prediction to listwise ranking of financial assets. We introduce a two-stage training process, supervised finetuning on Chain-of-Thought reasoning data, followed by our Financial Asset Ranking via Group Relative Policy Optimization with a Spearman rank correlation reward that aligns generated asset rankings with ground truth market orderings. The second stage uses a novel Spearman rank correlation reward to explicitly align the model's generative preferences with ground truth market orderings. Experimental results show that FinRankGRPO outperforms traditional quantitative and state-of-the-art commercial models, achieving a Sharpe ratio of 0.636 and a Spearman correlation of 0.023.

1. 15 May 2024

   Does Fine-Tuning LLMs on New Knowledge Encourage Hallucinations?

   Research shows that large language models have difficulty acquiring new factual knowledge through fine-tuning, learning new information slower than consistent knowledge, and are more likely to hallucinate, indicating the risks of introducing new facts through fine-tuning.

   Machine learningIn Conference on Empirical Methods in Natural Language Processing

   323cites
2. 27 Mar 2024

   TableLlama: Towards Open Large Generalist Models for Tables

   The paper presents TableLlama, an open-source large language model fine-tuned for table-based tasks, and introduces a new dataset, TableInstruct, which improves the performance and generalizability of these models.

   Machine learningIn North American Chapter of the Association for Computational Linguistics

   233cites
3. 17 Jan 2024

   Designing Heterogeneous LLM Agents for Financial Sentiment Analysis

   A study suggests using large language models without fine-tuning for financial sentiment analysis, offering a design framework that enhances accuracy.

   arXivIn ACM Transactions on Management Information Systems

   138cites
4. 28 Jun 2023

   Instruct-FinGPT: Financial Sentiment Analysis by Instruction Tuning of General-Purpose Large Language Models

   A new approach improves financial sentiment analysis by addressing limitations of language models.

   arXiv

   140cites
5. 7 Aug 2024

   AgentGen: Enhancing Planning Abilities for Large Language Model based Agent via Environment and Task Generation

   Enhancing LLM Planning: The study improves the planning abilities of Large Language Models (LLMs) using instruction tuning and a framework called AgentGen, which generates diverse environments and planning tasks.

   Machine learningIn Proceedings of the 31st ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.1

   93cites
6. 20 Aug 2025

   AlphaAgents: Large Language Model based Multi-Agents for Equity Portfolio Constructions

   The article investigates the application and effectiveness of role-based multi-agent AI systems in equity research and portfolio management, including their advantages and challenges.

   arXiv

   23cites