Shige Peng

Shaolin Ji, Shige Peng, Ying Peng et al.

In this paper,we mainly focus on the numerical solution of high-dimensional stochastic optimal control problem driven by fully-coupled forward-backward stochastic differential equations (FBSDEs in short) through deep learning. We first transform the problem into a stochastic Stackelberg differential game problem (leader-follower problem), then a bi-level optimization method is developed where the leader's cost functional and the follower's cost functional are optimized alternatively via deep neural networks. As for the numerical results, we compute two examples of the investment-consumption problem solved through stochastic recursive utility models, and the results of both examples demonstrate the effectiveness of our proposed algorithm.

Ziting Pei, Shige Peng, Xingye Yue et al.

A $G$-normal random variable $X\sim \mathcal{N}(0,[\underlineσ^2,\overlineσ^2])$ does not admit a unique probability law due to volatility uncertainty. For a given test function $ϕ$, the $G$-expectation admits the stochastic control representation$$\mathbb{E}[ϕ(X)] = \sup_{σ\in[\underlineσ,\overlineσ]} {E}\!\left[ϕ(X_T^σ)\mid X_0^σ=0\right] ={E}\!\left[ϕ(X_T^\ast)\mid X_0^\ast=0\right].$$ This formulation interprets the nonlinear expectation as a linear expectation under the law induced by the optimally controlled diffusion $X^\ast$, namely, the terminal law of $X_T^\ast$. This observation motivates the notion of a \emph{responsive distribution}, a measurement-dependent probability density $f_ϕ$ such that, for a given test function $ϕ$, $$\mathbb{E}[ϕ(X)] = \int_{\mathbb{R}} ϕ(x)\,f_ϕ(x)\,dx.$$ Based on this viewpoint, we propose a coupled backward--forward trinomial tree framework for computing the $G$-expectation and constructing the corresponding responsive distribution. The backward trinomial tree discretizes the associated stochastic optimal control problem and yields approximations of the value function (i.e., the $G$-expectation) and the optimal feedback control, while the forward trinomial tree propagates the induced transition probabilities and produces a discrete approximation of the responsive distribution. We establish rigorous convergence results for both components of the method. Numerical results not only validate the theoretical convergence of the coupled schemes but also provide a powerful, practical sampling tool to visualize the complex responsive distributions under various measurements.

Shaolin Ji, Shige Peng, Ying Peng et al.

In this paper, we mainly focus on solving high-dimensional stochastic Hamiltonian systems with boundary condition, which is essentially a Forward Backward Stochastic Differential Equation (FBSDE in short), and propose a novel method from the view of the stochastic control. In order to obtain the approximated solution of the Hamiltonian system, we first introduce a corresponding stochastic optimal control problem such that the extended Hamiltonian system of the control problem is exactly what we need to solve, then we develop two different algorithms suitable for different cases of the control problem and approximate the stochastic control via deep neural networks. From the numerical results, comparing with the Deep FBSDE method developed previously from the view of solving FBSDEs, the novel algorithms converge faster, which means that they require fewer training steps, and demonstrate more stable convergences for different Hamiltonian systems.

Shaolin Ji, Shige Peng, Ying Peng et al.

In this paper, we aim to solve the high dimensional stochastic optimal control problem from the view of the stochastic maximum principle via deep learning. By introducing the extended Hamiltonian system which is essentially an FBSDE with a maximum condition, we reformulate the original control problem as a new one. Three algorithms are proposed to solve the new control problem. Numerical results for different examples demonstrate the effectiveness of our proposed algorithms, especially in high dimensional cases. And an important application of this method is to calculate the sub-linear expectations, which correspond to a kind of fully nonlinear PDEs.

Shaolin Ji, Shige Peng, Ying Peng et al.

Recently, the deep learning method has been used for solving forward-backward stochastic differential equations (FBSDEs) and parabolic partial differential equations (PDEs). It has good accuracy and performance for high-dimensional problems. In this paper, we mainly solve fully coupled FBSDEs through deep learning and provide three algorithms. Several numerical results show remarkable performance especially for high-dimensional cases.