NALGApr 25, 2023

Efficient Bayesian inference using physics-informed invertible neural networks for inverse problems

arXiv:2304.12541v320 citationsh-index: 50
Originality Incremental advance
AI Analysis

This work addresses inverse problems in fields like physics and engineering by providing an efficient Bayesian inference method, though it is incremental as it builds on existing invertible neural network and physics-informed learning techniques.

The paper tackles Bayesian inverse problems by introducing physics-informed invertible neural networks (PI-INN), which combine invertible neural networks and neural basis networks to model solutions and enforce independence constraints, achieving superior performance in numerical experiments like inverse kinematics and diffusion equations compared to existing methods.

In this paper, we introduce an innovative approach for addressing Bayesian inverse problems through the utilization of physics-informed invertible neural networks (PI-INN). The PI-INN framework encompasses two sub-networks: an invertible neural network (INN) and a neural basis network (NB-Net). The primary role of the NB-Net lies in modeling the spatial basis functions characterizing the solution to the forward problem dictated by the underlying partial differential equation. Simultaneously, the INN is designed to partition the parameter vector linked to the input physical field into two distinct components: the expansion coefficients representing the forward problem solution and the Gaussian latent noise. If the forward mapping is precisely estimated, and the statistical independence between expansion coefficients and latent noise is well-maintained, the PI-INN offers a precise and efficient generative model for Bayesian inverse problems, yielding tractable posterior density estimates. As a particular physics-informed deep learning model, the primary training challenge for PI-INN centers on enforcing the independence constraint, which we tackle by introducing a novel independence loss based on estimated density. We support the efficacy and precision of the proposed PI-INN through a series of numerical experiments, including inverse kinematics, 1-dimensional and 2-dimensional diffusion equations, and seismic traveltime tomography. Specifically, our experimental results showcase the superior performance of the proposed independence loss in comparison to the commonly used but computationally demanding kernel-based maximum mean discrepancy loss.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes