Exploring Microstructural Dynamics in Cryptocurrency Limit Order Books: Better Inputs Matter More Than Stacking Another Hidden Layer
Exploring Microstructural Dynamics in Cryptocurrency Limit Order Books: Better Inputs Matter More Than Stacking Another Hidden Layer
This paper investigates whether increasing model complexity in deep learning architectures genuinely improves short-term price prediction from limit order book (LOB) data, or if gains are primarily driven by data preprocessing and feature engineering. Using 100ms snapshots of BTC/USDT from Bybit, the authors benchmark six models—ranging from logistic regression and XGBoost to deep architectures like DeepLOB and CNN+LSTM—on binary and ternary classification tasks at horizons of 100ms, 500ms, and 1 second. Two denoising techniques, Savitzky–Golay smoothing and Kalman filtering, are applied to raw LOB data to mitigate microstructural noise.
The results show that Savitzky–Golay filtering consistently improves predictive accuracy across all models, while Kalman filtering often underperforms relative to raw data. Surprisingly, simpler models such as logistic regression and XGBoost achieve comparable or even superior F1 scores compared to complex neural networks, especially when combined with proper preprocessing. For example, at the 500ms horizon with 40-level LOB data, logistic regression with Savitzky–Golay filtering reaches 72.84% binary accuracy, outperforming DeepLOB (71.89%). The study also reveals a trade-off between LOB depth and data coverage: deeper levels provide more information but reduce the number of usable snapshots, lowering overall accuracy.
The key contribution is demonstrating that careful data preprocessing and feature engineering can be more impactful than adding hidden layers or parameters. This finding has practical implications for high-frequency trading, where model interpretability, low latency, and robustness are critical. The authors advocate for a focus on input quality over architectural complexity in LOB-based forecasting.
Highlights
- 1Demonstrates that simpler models with proper preprocessing can match or exceed complex deep learning architectures for LOB-based price prediction.
- 2Introduces and compares Kalman and Savitzky–Golay filtering techniques to denoise raw LOB data, showing significant accuracy improvements.
- 3Evaluates binary and ternary classification across multiple horizons (100ms, 500ms, 1s) and LOB depths on real BTC/USDT data from Bybit.
- 4Highlights the trade-off between market coverage and predictive performance when varying LOB depth.
Methods
- MSavitzky–Golay smoothing and Kalman filtering for LOB denoising.
- MBenchmarking of logistic regression, XGBoost, CatBoost, CNN+LSTM, CNN+XGBoost hybrid, and DeepLOB models.
- MBinary (up/down) and ternary (up/flat/down) classification with inverse-frequency weighting to handle class imbalance.
- MFeature engineering including order imbalance, weighted mid-price change, and rolling window statistics.
Results
- RSavitzky–Golay filtering consistently improves accuracy over raw and Kalman-filtered data across all models and horizons.
- RSimpler models (logistic regression, XGBoost) achieve comparable or better F1 scores than deep architectures (DeepLOB, CNN+LSTM) when using filtered data.
- RBinary classification at 500ms horizon with 40-level LOB and Savitzky–Golay filtering yields highest accuracy (up to 0.7284 for logistic regression).
- RIncreasing LOB depth improves accuracy but reduces sample size due to missing levels, creating a coverage-performance trade-off.
- RKalman filtering often degrades performance compared to raw data, suggesting it may over-smooth informative microstructure signals.
Analyze Paper
Generate insights from "Exploring Microstructural Dynamics in Cryptocurrency Limit O...".