APLGNAOCFeb 25, 2022

A blob method for inhomogeneous diffusion with applications to multi-agent control and sampling

arXiv:2202.12927v319 citations
Originality Incremental advance
AI Analysis

This work provides a novel deterministic approach for inhomogeneous diffusion problems, with incremental improvements over existing blob methods, benefiting researchers in PDEs, multi-agent systems, and machine learning.

The authors developed a deterministic particle method for the weighted porous medium equation, proving its convergence on bounded time intervals and capturing correct asymptotic behavior, with applications to multi-agent control and sampling probability measures. They also linked it to training two-layer neural networks, identifying conditions for convexity in the continuum limit.

As a counterpoint to classical stochastic particle methods for linear diffusion equations, we develop a deterministic particle method for the weighted porous medium equation (WPME) and prove its convergence on bounded time intervals. This generalizes related work on blob methods for unweighted porous medium equations. From a numerical analysis perspective, our method has several advantages: it is meshfree, preserves the gradient flow structure of the underlying PDE, converges in arbitrary dimension, and captures the correct asymptotic behavior in simulations. That our method succeeds in capturing the long time behavior of WPME is significant from the perspective of related problems in quantization. Just as the Fokker-Planck equation provides a way to quantize a probability measure $\barρ$ by evolving an empirical measure according to stochastic Langevin dynamics so that the empirical measure flows toward $\barρ$, our particle method provides a way to quantize $\barρ$ according to deterministic particle dynamics approximating WMPE. In this way, our method has natural applications to multi-agent coverage algorithms and sampling probability measures. A specific case of our method corresponds exactly to confined mean-field dynamics of training a two-layer neural network for a radial basis function activation function. From this perspective, our convergence result shows that, in the overparametrized regime and as the variance of the radial basis functions goes to zero, the continuum limit is given by WPME. This generalizes previous results, which considered the case of a uniform data distribution, to the more general inhomogeneous setting. As a consequence of our convergence result, we identify conditions on the target function and data distribution for which convexity of the energy landscape emerges in the continuum limit.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes