Latent-IMH: Efficient Bayesian Inference for Inverse Problems with Approximate Operators
This addresses computational bottlenecks in Bayesian inference for inverse problems, offering significant efficiency gains for applications with expensive operators, though it is incremental as it builds on existing Metropolis-Hastings independence sampling.
The paper tackles the problem of sampling from posterior distributions in Bayesian linear inverse problems with computationally expensive operators by introducing Latent-IMH, a method that uses an approximate operator to generate latent variables and refines them with the exact operator, resulting in orders of magnitude faster performance than state-of-the-art methods like NUTS in some cases.
We study sampling from posterior distributions in Bayesian linear inverse problems where $A$, the parameters to observables operator, is computationally expensive. In many applications, $A$ can be factored in a manner that facilitates the construction of a cost-effective approximation $\tilde{A}$. In this framework, we introduce Latent-IMH, a sampling method based on the Metropolis-Hastings independence (IMH) sampler. Latent-IMH first generates intermediate latent variables using the approximate $\tilde{A}$, and then refines them using the exact $A$. Its primary benefit is that it shifts the computational cost to an offline phase. We theoretically analyze the performance of Latent-IMH using KL divergence and mixing time bounds. Using numerical experiments on several model problems, we show that, under reasonable assumptions, it outperforms state-of-the-art methods such as the No-U-Turn sampler (NUTS) in computational efficiency. In some cases, Latent-IMH can be orders of magnitude faster than existing schemes.