Towards Robust Representation of Limit Orders Books for Deep Learning Models
Towards Robust Representation of Limit Orders Books for Deep Learning Models
This paper addresses the overlooked issue of limit order book (LOB) data representation for deep learning models. The authors identify that the commonly used compressed representation, which organizes LOB data by price levels, violates key assumptions of neural networks such as spatial homogeneity and source consistency across input channels. This leads to fragility under adversarial perturbations, where minimal market orders cause drastic shifts in the representation. To overcome these issues, the paper proposes two alternative representations: a moving-window representation that encodes volumes in a fixed grid centered at the mid-price, and a market-depth representation that accumulates volumes for improved spatial smoothness. Both representations are designed to be compatible with convolutional and recurrent architectures.
Through experiments on the FI-2010 dataset, the authors demonstrate that the proposed representations significantly enhance model robustness and accuracy. Under adversarial perturbations simulating small limit orders, models using compressed representations suffer substantial performance drops (e.g., DeepLOB accuracy falls from 77.30% to 69.02%), while models using moving-window or market-depth representations maintain stable performance. Moreover, even simple models like LSTM with market-depth representation achieve state-of-the-art results (77.46% accuracy) without complex architectures. The work emphasizes that data representation is as critical as model design in quantitative finance, and provides practical guidelines for constructing robust LOB representations that align with deep learning principles.
Highlights
- 1Identifies critical flaws in the commonly used compressed representation of limit order book data for deep learning models, including lack of spatial homogeneity and vulnerability to level shifts.
- 2Proposes two novel robust representations: moving-window representation and market-depth representation, which align with the assumptions of deep learning models.
- 3Introduces an adversarial perturbation scheme simulating minimal market orders to evaluate representation robustness, showing compressed representations amplify perturbations dramatically.
- 4Demonstrates that simple neural network architectures with the proposed representations achieve state-of-the-art accuracy and robustness, outperforming complex models like DeepLOB on perturbed data.
- 5Establishes desiderata for LOB representations in machine learning: clarity, efficiency, smoothness, and compatibility with model assumptions.
Methods
- MAdversarial perturbation testing: adding minimum-size orders at empty price levels to evaluate representation stability.
- MMoving-window representation: encoding LOB snapshots as fixed-size matrices centered at mid-price, with volumes as signed values.
- MMarket-depth representation: cumulative volume representation derived from moving-window to improve spatial smoothness.
- MComparison of multiple models: linear, MLP, LSTM, DeepLOB, and temporal convolutional networks (TCNs) across representations.
Results
- RCompressed representation suffers from severe performance drops under adversarial perturbations (e.g., DeepLOB accuracy drops from 77.30% to 69.02% on ask-side perturbation).
- RMoving-window and market-depth representations maintain stable performance across all perturbation types (e.g., LSTM accuracy ~75% and ~77% respectively, unchanged).
- RMarket-depth representation achieves highest accuracy (77.46%) and F-score (76.18%) with LSTM, outperforming compressed representation with DeepLOB (77.30% accuracy).
- RSimple models (MLP, LSTM) with proposed representations match or exceed complex models (DeepLOB) on compressed data, especially under perturbations.
- RLinear model accuracy improves from 52.98% (compressed) to 59.57% (moving-window) on unperturbed data, showing representation impact even on simple models.
Analyze Paper
Generate insights from "Towards Robust Representation of Limit Orders Books for Deep...".