Variational Inference Using Material Point Method
This provides a new deterministic sampling method for variational inference in probabilistic models, addressing challenges in intractable densities and score-based generative modeling.
The paper tackles variational inference by proposing MPM-ParVI, a gradient-based particle sampling method based on the material point method, which simulates deformable body dynamics to approximate target densities; it offers deterministic sampling for probabilistic models like Bayesian inference and generative modeling.
A new gradient-based particle sampling method, MPM-ParVI, based on material point method (MPM), is proposed for variational inference. MPM-ParVI simulates the deformation of a deformable body (e.g. a solid or fluid) under external effects driven by the target density; transient or steady configuration of the deformable body approximates the target density. The continuum material is modelled as an interacting particle system (IPS) using MPM, each particle carries full physical properties, interacts and evolves following conservation dynamics. This easy-to-implement ParVI method offers deterministic sampling and inference for a class of probabilistic models such as those encountered in Bayesian inference (e.g. intractable densities) and generative modelling (e.g. score-based).