Deep Reinforcement Learning in Cryptocurrency Market Making

—

Deep Reinforcement Learning in Cryptocurrency Market Making

Jonathan Sadighian
Published on 11/20/2019
Crypto
Machine learning
Deep learning
Reinforcement learning
High frequency trading
Risk management

This paper presents a novel deep reinforcement learning framework for market making in cryptocurrency markets, termed DRLMM. It addresses the stochastic inventory control challenges faced by market makers by employing two advanced policy gradient-based algorithms that interact with a simulated environment. The environment is constructed using limit order book data and order flow arrival statistics, with a forward-feed neural network serving as the function approximator. The study compares two different reward functions to optimize agent performance, evaluating outcomes through daily and average trade returns.

The research demonstrates the effectiveness of deep reinforcement learning in enhancing market making strategies, particularly in the volatile and data-rich context of cryptocurrencies. By leveraging policy gradient methods and neural networks, the framework enables agents to learn adaptive trading policies that manage inventory risks and capitalize on market opportunities. The findings highlight the potential of DRLMM to improve profitability and efficiency in high-frequency trading, contributing to the growing body of literature on AI applications in quantitative finance.

Highlights

  • 1Introduces a deep reinforcement learning framework for cryptocurrency market making (DRLMM)
  • 2Compares two policy gradient-based algorithms with different reward functions
  • 3Uses limit order book data and order flow statistics as observation space
  • 4Demonstrates effectiveness in solving stochastic inventory control problems
  • 5Evaluates performance via daily and average trade returns

Methods

  • M
    Deep reinforcement learning with policy gradient algorithms
  • M
    Forward-feed neural network as function approximator
  • M
    Simulation environment based on limit order book data and order flow statistics
  • M
    Comparison of two reward functions for agent training

Results

  • R
    DRLMM framework effectively addresses market making challenges in cryptocurrency markets
  • R
    Policy gradient agents show adaptability to stochastic inventory control
  • R
    Performance varies based on reward function and algorithm combination
  • R
    Daily and average trade returns provide quantitative evaluation metrics
  • R
    Deep learning enhances decision-making in high-frequency trading environments
0/5

Analyze Paper

Generate insights from "Deep Reinforcement Learning in Cryptocurrency Market Making".

Suggested Actions