High-Order Langevin Monte Carlo Algorithms
This work addresses sampling efficiency for data scientists, offering incremental improvements over existing Langevin methods with new theoretical convergence bounds.
The authors tackled the problem of large-scale sampling in data science by proposing high-order Langevin Monte Carlo algorithms for any order P≥3, achieving improved mixing times with better dependence on dimension and accuracy as P increases, as shown by theoretical guarantees and numerical experiments.
Langevin algorithms are popular Markov chain Monte Carlo (MCMC) methods for large-scale sampling problems that often arise in data science. We propose Monte Carlo algorithms based on the discretizations of $P$-th order Langevin dynamics for any $P\geq 3$. Our design of $P$-th order Langevin Monte Carlo (LMC) algorithms is by combining splitting and accurate integration methods. We obtain Wasserstein convergence guarantees for sampling from distributions with log-concave and smooth densities. Specifically, the mixing time of the $P$-th order LMC algorithm scales as $O\left(d^{\frac{1}{R}}/ε^{\frac{1}{2R}}\right)$ for $R=4\cdot 1_{\{ P=3\}}+ (2P-1)\cdot 1_{\{ P\geq 4\}}$, which has a better dependence on the dimension $d$ and the accuracy level $ε$ as $P$ grows. Numerical experiments illustrate the efficiency of our proposed algorithms.