NAApr 30, 2013
Complexity Analysis of Accelerated MCMC Methods for Bayesian InversionViet Ha Hoang, Christoph Schwab, Andrew M. Stuart
We study Bayesian inversion for a model elliptic PDE with unknown diffusion coefficient. We provide complexity analyses of several Markov Chain-Monte Carlo (MCMC) methods for the efficient numerical evaluation of expectations under the Bayesian posterior distribution, given data $δ$. Particular attention is given to bounds on the overall work required to achieve a prescribed error level $\varepsilon$. Specifically, we first bound the computational complexity of "plain" MCMC, based on combining MCMC sampling with linear complexity multilevel solvers for elliptic PDE. Our (new) work versus accuracy bounds show that the complexity of this approach can be quite prohibitive. Two strategies for reducing the computational complexity are then proposed and analyzed: first, a sparse, parametric and deterministic generalized polynomial chaos (gpc) "surrogate" representation of the forward response map of the PDE over the entire parameter space, and, second, a novel Multi-Level Markov Chain Monte Carlo (MLMCMC) strategy which utilizes sampling from a multilevel discretization of the posterior and of the forward PDE. For both of these strategies we derive asymptotic bounds on work versus accuracy, and hence asymptotic bounds on the computational complexity of the algorithms. In particular we provide sufficient conditions on the regularity of the unknown coefficients of the PDE, and on the approximation methods used, in order for the accelerations of MCMC resulting from these strategies to lead to complexity reductions over "plain" MCMC algorithms for Bayesian inversion of PDEs.}
NAAug 3, 2018
Bayesian inverse problems for recovering coefficients of two scale elliptic equationsViet Ha Hoang, Jia Hao Quek
We consider the Bayesian inverse homogenization problem of recovering the locally periodic two scale coefficient of a two scale elliptic equation, given limited noisy information on the solution. We consider both the uniform and the Gaussian prior probability measures. We use the two scale homogenized equation whose solution contains the solution of the homogenized equation which describes the macroscopic behaviour, and the corrector which encodes the microscopic behaviour. We approximate the posterior probability by a probability measure determined by the solution of the two scale homogenized equation. We show that the Hellinger distance of these measures converges to zero when the microscale converges to zero, and establish an explicit convergence rate when the solution of the two scale homogenized equation is sufficiently regular. Sampling the posterior measure by Markov Chain Monte Carlo (MCMC) method, instead of solving the two scale equation using fine mesh for each proposal with extremely high cost, we can solve the macroscopic two scale homogenized equation. Although this equation is posed in a high dimensional tensorized domain, it can be solved with essentially optimal complexity by the sparse tensor product finite element method, which reduces the computational complexity of the MCMC sampling method substantially. We show numerically that observations on the macrosopic behaviour alone are not sufficient to infer the microstructure. We need also observations on the corrector. Solving the two scale homogenized equation, we get both the solution to the homogenized equation and the corrector. Thus our method is particularly suitable for sampling the posterior measure of two scale coefficients.
66.0NAMar 16
Sparsity for parametric PDEs with log-gamma random inputs and applicationsDinh Dũng, Van Kien Nguyen, Viet Ha Hoang
We propose a novel method for establishing the sparsity of the coefficients of the Laguerre generalized polynomial chaos expansion of solutions to parametric elliptic PDEs with log-gamma inputs on $\mathbb{R}_+^\infty$. The established sparsity is quantified by $\ell_p$-summability and weighted $\ell_2$-summability of the coefficients. Building on these sparsity results, we derive convergence rates for semi-discrete approximations in the parametric variables. These rates apply to sparse-grid polynomial interpolations, extended least-squares approximations and the associated semi-discrete quadrature rules. Moreover, a counterpart of our method for parametric elliptic PDEs with log-normal inputs yields a significant improvement in the sufficient condition for $\ell_p$-summability when the component functions in the log-normal representation of the parametric diffusion coefficients have global support, compared with results obtained in prior works.
NAAug 7, 2017
High dimensional finite elements for multiscale Maxwell wave equationsVan Tiep Chu, Viet Ha Hoang
We develop an essentially optimal numerical method for solving multiscale Maxwell wave equations in a domain $D\subset{\mathbb R}^d$. The problems depend on $n+1$ scales: one macroscopic scale and $n$ microscopic scales. Solving the macroscopic multiscale homogenized problem, we obtain the desired macroscopic and microscopic information. This problem depends on $n+1$ variables in ${\mathbb R}^d$, one for each scale that the original multiscale equation depends on, and is thus posed in a high dimensional tensorized domain. The straightforward full tensor product finite element (FE) method is exceedingly expensive. We develop the sparse tensor product FEs that solve this multiscale homogenized problem with essentially optimal number of degrees of freedom, that is essentially equal to that required for solving a macroscopic problem in a domain in ${\mathbb R}^d$ only, for obtaining a required level of accuracy. Numerical correctors are constructed from the FE solution. For two scale problems, we derive a rate of convergence for the numerical corrector in terms of the microscopic scale and the FE mesh width. Numerical examples confirm our analysis.