Get Real: Realism Metrics for Robust Limit Order Book Market Simulations
Get Real: Realism Metrics for Robust Limit Order Book Market Simulations
This paper addresses the challenge of ensuring realism in limit order book (LOB) market simulations, which are critical for training and testing trading strategies, especially those using reinforcement learning. The authors survey the literature to compile a comprehensive set of realism metrics, or stylized facts, that characterize real market behavior, including properties of asset return distributions (e.g., heavy tails, volatility clustering), order flow (e.g., power-law order sizes, interarrival times), intraday patterns, and market impact. They provide mathematical formulations for these metrics and use them to evaluate two agent configurations within the ABIDES simulation platform: one composed solely of zero-intelligence (ZI) agents and another mixing ZI agents with minimal strategic agents (market maker, heuristic belief learning, and momentum agents).
Experimental results show that while both configurations capture some stylized facts (e.g., heavy tails and volatility clustering), the mixed configuration generally performs better, producing statistics closer to historical data from U.S. equities. However, significant discrepancies remain, particularly in reproducing the absence of return autocorrelations, realistic order interarrival times, and the U-shaped intraday volume pattern. The authors conclude that current agent-based simulations still fall short of full realism and suggest that incorporating online learning and adaptive agents, which can evolve their strategies in response to market conditions, is a promising direction for improving fidelity. This work serves as a benchmark for future research, providing a standardized set of metrics to measure progress in market simulation realism.
Highlights
- 1Provides a comprehensive catalog of realism metrics for limit order book market simulations, including mathematical formulations.
- 2Evaluates two agent configurations (zero-intelligence only vs. mixed with strategic agents) using the ABIDES simulation platform.
- 3Demonstrates that diverse agent populations better reproduce stylized facts of real markets, but significant discrepancies remain.
- 4Identifies key areas for improvement, such as intraday volume patterns and order flow time correlations.
- 5Suggests that online learning and adaptive agents are necessary for more robust market simulations.
Methods
- MAgent-based modeling using the ABIDES discrete event simulation environment.
- MComparison of simulated and historical market data across multiple stylized fact categories (return distributions, order flow, intraday patterns, market impact).
- MStatistical analysis including autocorrelation, distribution fitting (Gamma, Weibull, power-law), and regression for volume-volatility correlation.
- MTwo agent configurations: zero-intelligence (ZI) only and mixed (ZI, market maker, heuristic belief learning, momentum agents).
Results
- RBoth configurations exhibit heavy tails and aggregational normality, with the mixed configuration closer to historical data.
- RNeither configuration captures the absence of autocorrelations in returns; the mixed configuration shows a more similar distribution shape.
- RVolatility clustering is reproduced by both configurations, but volume-volatility correlation is weaker and less skewed than in real markets.
- ROrder interarrival times in simulations are dominated by near-zero values, poorly fitting the Weibull distribution seen historically.
- RIntraday volume patterns in the mixed configuration show reduced activity at market open and close, opposite to the U-shaped pattern in real data.
Analyze Paper
Generate insights from "Get Real: Realism Metrics for Robust Limit Order Book Market...".