---
title: Reinforcement Learning and Rational Expectations Equilibrium in Limit Order Markets
url: https://www.ml-quant.com/papers/ssrn/4682574/
site: ML-Quant (https://www.ml-quant.com)
updated: 2026-09-26
license: Summaries CC BY 4.0; links go to the original sources
index: https://www.ml-quant.com/llms.txt
identifier: SSRN 4682574
source_url: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4682574
featured: 2024-01-09
citations: 2
topic: ML & AI Methods
---


# Reinforcement Learning and Rational Expectations Equilibrium in Limit Order Markets

A paper suggests that simple payoff-based reinforcement learning can help achieve rational expectations equilibrium in limit order markets, with speculators mainly providing liquidity.

- Source: https://papers.ssrn.com/sol3/papers.cfm?abstract_id=4682574
- Identifier: SSRN 4682574
- Released: 2023-12-28
- First featured: Quant Letter No. 32 (2024-01-09): https://www.ml-quant.com/issues/2024-01-09/
- Citations (Semantic Scholar): 2
- Published in: not yet
- Topic: ML & AI Methods

## Related

- [Mastering Diverse Domains through World Models](https://www.ml-quant.com/papers/arxiv/2301.04104/): Algorithm Mastery: DreamerV3, a universal algorithm, excels in over 150 varied tasks, including diamond collection in Minecraft without human input, expanding the scope of reinforcement learning.
- [SimPO: Simple Preference Optimization with a Reference-Free Reward](https://www.ml-quant.com/papers/arxiv/2405.14734/): Simple Preference Optimization: SimPO improves reinforcement learning from human feedback by using the average log probability of a sequence as the implicit reward, enhancing training stability and computational efficiency.
- [Settling the Sample Complexity of Model-Based Offline Reinforcement Learning](https://www.ml-quant.com/papers/arxiv/2204.05275/): A paper reveals that a model-based approach can achieve optimal sample complexity without burn-in cost in offline reinforcement learning for tabular Markov decision processes, providing an efficient solution for sample-starved applications.
- [DPO Meets PPO: Reinforced Token Optimization for RLHF](https://www.ml-quant.com/papers/arxiv/2404.18922/): A new framework is introduced that models Reinforcement Learning from Human Feedback as a Markov decision process, using an algorithm that learns from preference data.
- [Transformers as Decision Makers: Provable In-Context Reinforcement Learning via Supervised Pretraining](https://www.ml-quant.com/papers/arxiv/2310.08566/): The article presents a theoretical framework for training large transformer models for in-context reinforcement learning, offering the first quantitative analysis of their capabilities.
- [Critique-out-Loud Reward Models](https://www.ml-quant.com/papers/arxiv/2408.11791/): The article presents CLoud reward models that use human feedback to improve reinforcement learning, enhancing accuracy and win rate in ArenaHard.