OCLGSYMATH-PHMLJun 1, 2024

Schrödinger Bridge with Quadratic State Cost is Exactly Solvable

arXiv:2406.00503v410 citations
Originality Incremental advance
AI Analysis

This work advances the state-of-the-art in stochastic optimal control and generative diffusion models by providing an exact solution for a previously limited case, though it is incremental as it extends existing theory to non-Gaussian endpoints.

The authors tackled the problem of solving a regularized Schrödinger bridge with a quadratic state cost, which involves a reaction-diffusion PDE, by deriving a closed-form Markov kernel for arbitrary non-Gaussian endpoint distributions, enabling exact solvability and numerical computation via dynamic Sinkhorn recursion.

Schrödinger bridge is a diffusion process that steers a given distribution to another in a prescribed time while minimizing the effort to do so. It can be seen as the stochastic dynamical version of the optimal mass transport, and has growing applications in generative diffusion models and stochastic optimal control. {\black{We say a Schrödinger bridge is ``exactly solvable'' if the associated uncontrolled Markov kernel is available in closed form, since then the bridge can be numerically computed using dynamic Sinkhorn recursion for arbitrary endpoint distributions with finite second moments.}} In this work, we propose a regularized variant of the Schrödinger bridge with a quadratic state cost-to-go that incentivizes the optimal sample paths to stay close to a nominal level. Unlike the conventional Schrödinger bridge, the regularization induces a state-dependent rate of killing and creation of probability mass, and its solution requires determining the Markov kernel of a reaction-diffusion partial differential equation. We derive this Markov kernel in closed form, {\black{showing that the regularized Schrödinger bridge is exactly solvable, even for non-Gaussian endpoints. This advances the state-of-the-art because closed form Markov kernel for the regularized Schrödinger bridge is available in existing literature only for Gaussian endpoints}}. Our solution recovers the heat kernel in the vanishing regularization (i.e., diffusion without reaction) limit, thereby recovering the solution of the conventional Schrödinger bridge {\black{as a special case}}. We deduce properties of the new kernel and explain its connections with certain exactly solvable models in quantum mechanics.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes