Towards Robust Representation of Limit Orders Books for Deep Learning Models

—

Towards Robust Representation of Limit Orders Books for Deep Learning Models

Yufei Wu
Mahmoud Mahfouz
Daniele Magazzeni
Manuela Veloso
Published on 10/10/2021
Equities
Machine learning
Deep learning
High frequency trading

This paper addresses the overlooked issue of limit order book (LOB) data representation for deep learning models. The authors identify that the commonly used compressed representation, which organizes LOB data by price levels, violates key assumptions of neural networks such as spatial homogeneity and source consistency across input channels. This leads to fragility under adversarial perturbations, where minimal market orders cause drastic shifts in the representation. To overcome these issues, the paper proposes two alternative representations: a moving-window representation that encodes volumes in a fixed grid centered at the mid-price, and a market-depth representation that accumulates volumes for improved spatial smoothness. Both representations are designed to be compatible with convolutional and recurrent architectures.

Through experiments on the FI-2010 dataset, the authors demonstrate that the proposed representations significantly enhance model robustness and accuracy. Under adversarial perturbations simulating small limit orders, models using compressed representations suffer substantial performance drops (e.g., DeepLOB accuracy falls from 77.30% to 69.02%), while models using moving-window or market-depth representations maintain stable performance. Moreover, even simple models like LSTM with market-depth representation achieve state-of-the-art results (77.46% accuracy) without complex architectures. The work emphasizes that data representation is as critical as model design in quantitative finance, and provides practical guidelines for constructing robust LOB representations that align with deep learning principles.

Highlights

  • 1Identifies critical flaws in the commonly used compressed representation of limit order book data for deep learning models, including lack of spatial homogeneity and vulnerability to level shifts.
  • 2Proposes two novel robust representations: moving-window representation and market-depth representation, which align with the assumptions of deep learning models.
  • 3Introduces an adversarial perturbation scheme simulating minimal market orders to evaluate representation robustness, showing compressed representations amplify perturbations dramatically.
  • 4Demonstrates that simple neural network architectures with the proposed representations achieve state-of-the-art accuracy and robustness, outperforming complex models like DeepLOB on perturbed data.
  • 5Establishes desiderata for LOB representations in machine learning: clarity, efficiency, smoothness, and compatibility with model assumptions.

Methods

  • M
    Adversarial perturbation testing: adding minimum-size orders at empty price levels to evaluate representation stability.
  • M
    Moving-window representation: encoding LOB snapshots as fixed-size matrices centered at mid-price, with volumes as signed values.
  • M
    Market-depth representation: cumulative volume representation derived from moving-window to improve spatial smoothness.
  • M
    Comparison of multiple models: linear, MLP, LSTM, DeepLOB, and temporal convolutional networks (TCNs) across representations.

Results

  • R
    Compressed representation suffers from severe performance drops under adversarial perturbations (e.g., DeepLOB accuracy drops from 77.30% to 69.02% on ask-side perturbation).
  • R
    Moving-window and market-depth representations maintain stable performance across all perturbation types (e.g., LSTM accuracy ~75% and ~77% respectively, unchanged).
  • R
    Market-depth representation achieves highest accuracy (77.46%) and F-score (76.18%) with LSTM, outperforming compressed representation with DeepLOB (77.30% accuracy).
  • R
    Simple models (MLP, LSTM) with proposed representations match or exceed complex models (DeepLOB) on compressed data, especially under perturbations.
  • R
    Linear model accuracy improves from 52.98% (compressed) to 59.57% (moving-window) on unperturbed data, showing representation impact even on simple models.
0/5

Analyze Paper

Generate insights from "Towards Robust Representation of Limit Orders Books for Deep...".

Suggested Actions