Machine learning approximation algorithms for high-dimensional fully nonlinear partial differential equations and second-order backward stochastic differential equations

—

Machine learning approximation algorithms for high-dimensional fully nonlinear partial differential equations and second-order backward stochastic differential equations

Christian Beck
Weinan E
Arnulf Jentzen
Published on 9/18/2017
Derivatives
Machine learning
Deep learning
Risk management

This paper introduces a novel machine learning algorithm, termed the deep 2BSDE method, for solving high-dimensional fully nonlinear second-order partial differential equations (PDEs) and second-order backward stochastic differential equations (2BSDEs). Such PDEs are prevalent in quantitative finance, for example in derivative pricing under Knightian uncertainty, portfolio optimization, and credit valuation adjustment models, but their high dimensionality typically renders classical numerical methods infeasible due to the curse of dimensionality. The key innovation is to reformulate the PDE problem using a connection between fully nonlinear PDEs and 2BSDEs, leading to a merged formulation that can be discretized forward in time. This discretization involves unknown functions (the Hessian of the solution and a drift term) which are then approximated by deep neural networks. The parameters of these networks, along with the initial values of the solution and its gradient, are learned by minimizing a loss function that measures the error between the prescribed terminal condition and the forward simulation of the 2BSDE. The optimization is performed using stochastic gradient descent-type methods. The authors demonstrate the effectiveness of their approach through numerical experiments on several high-dimensional problems, including a 100-dimensional Black-Scholes-Barenblatt equation, a 100-dimensional Hamilton-Jacobi-Bellman equation, and nonlinear expectations of G-Brownian motion in 1 and 100 dimensions. The results show that the method can accurately approximate solutions in high dimensions, overcoming the curse of dimensionality and providing a practical tool for solving fully nonlinear PDEs arising in financial engineering and other fields.

Highlights

  • 1Proposes a novel deep learning-based algorithm (deep 2BSDE method) for solving high-dimensional fully nonlinear second-order PDEs and 2BSDEs.
  • 2Leverages a merged formulation of the PDE and 2BSDE to reformulate the problem as a learning task, enabling the use of neural networks and stochastic gradient descent.
  • 3Demonstrates the method's effectiveness on 100-dimensional Black-Scholes-Barenblatt, Hamilton-Jacobi-Bellman equations, and nonlinear expectations of G-Brownian motion.
  • 4Provides a practical algorithm that overcomes the curse of dimensionality for fully nonlinear PDEs, a significant challenge in quantitative finance.

Methods

  • M
    Connection between fully nonlinear PDEs and second-order backward stochastic differential equations (2BSDEs).
  • M
    Merged formulation of the PDE and 2BSDE to create a forward-discretized system.
  • M
    Deep neural network approximations for the Hessian and drift terms in the discretized system.
  • M
    Stochastic gradient descent-type optimization to minimize the error between the terminal condition and the forward simulation.

Results

  • R
    The deep 2BSDE method accurately approximates solutions of 100-dimensional fully nonlinear PDEs, including Black-Scholes-Barenblatt and Hamilton-Jacobi-Bellman equations.
  • R
    The method successfully computes nonlinear expectations of G-Brownian motion in up to 100 dimensions.
  • R
    Numerical experiments show the algorithm scales well with dimension, avoiding the exponential growth of traditional methods.
  • R
    The algorithm achieves high accuracy with relatively small neural networks and modest computational resources.
0/5

Analyze Paper

Generate insights from "Machine learning approximation algorithms for high-dimension...".

Suggested Actions