Get Real: Realism Metrics for Robust Limit Order Book Market Simulations

—

Get Real: Realism Metrics for Robust Limit Order Book Market Simulations

Svitlana Vyetrenko
David Byrd
Nick Petosa
Mahmoud Mahfouz
Danial Dervovic
Manuela Veloso
Tucker Hybinette Balch
Published on 12/10/2019
Equities
Futures
Options
Machine learning
Reinforcement learning
High frequency trading
Backtesting
Risk management

This paper addresses the challenge of ensuring realism in limit order book (LOB) market simulations, which are critical for training and testing trading strategies, especially those using reinforcement learning. The authors survey the literature to compile a comprehensive set of realism metrics, or stylized facts, that characterize real market behavior, including properties of asset return distributions (e.g., heavy tails, volatility clustering), order flow (e.g., power-law order sizes, interarrival times), intraday patterns, and market impact. They provide mathematical formulations for these metrics and use them to evaluate two agent configurations within the ABIDES simulation platform: one composed solely of zero-intelligence (ZI) agents and another mixing ZI agents with minimal strategic agents (market maker, heuristic belief learning, and momentum agents).

Experimental results show that while both configurations capture some stylized facts (e.g., heavy tails and volatility clustering), the mixed configuration generally performs better, producing statistics closer to historical data from U.S. equities. However, significant discrepancies remain, particularly in reproducing the absence of return autocorrelations, realistic order interarrival times, and the U-shaped intraday volume pattern. The authors conclude that current agent-based simulations still fall short of full realism and suggest that incorporating online learning and adaptive agents, which can evolve their strategies in response to market conditions, is a promising direction for improving fidelity. This work serves as a benchmark for future research, providing a standardized set of metrics to measure progress in market simulation realism.

Highlights

  • 1Provides a comprehensive catalog of realism metrics for limit order book market simulations, including mathematical formulations.
  • 2Evaluates two agent configurations (zero-intelligence only vs. mixed with strategic agents) using the ABIDES simulation platform.
  • 3Demonstrates that diverse agent populations better reproduce stylized facts of real markets, but significant discrepancies remain.
  • 4Identifies key areas for improvement, such as intraday volume patterns and order flow time correlations.
  • 5Suggests that online learning and adaptive agents are necessary for more robust market simulations.

Methods

  • M
    Agent-based modeling using the ABIDES discrete event simulation environment.
  • M
    Comparison of simulated and historical market data across multiple stylized fact categories (return distributions, order flow, intraday patterns, market impact).
  • M
    Statistical analysis including autocorrelation, distribution fitting (Gamma, Weibull, power-law), and regression for volume-volatility correlation.
  • M
    Two agent configurations: zero-intelligence (ZI) only and mixed (ZI, market maker, heuristic belief learning, momentum agents).

Results

  • R
    Both configurations exhibit heavy tails and aggregational normality, with the mixed configuration closer to historical data.
  • R
    Neither configuration captures the absence of autocorrelations in returns; the mixed configuration shows a more similar distribution shape.
  • R
    Volatility clustering is reproduced by both configurations, but volume-volatility correlation is weaker and less skewed than in real markets.
  • R
    Order interarrival times in simulations are dominated by near-zero values, poorly fitting the Weibull distribution seen historically.
  • R
    Intraday volume patterns in the mixed configuration show reduced activity at market open and close, opposite to the U-shaped pattern in real data.
0/5

Analyze Paper

Generate insights from "Get Real: Realism Metrics for Robust Limit Order Book Market...".

Suggested Actions