12.2NAOct 6, 2022
Residual-based error correction for neural operator accelerated infinite-dimensional Bayesian inverse problemsLianghao Cao, Thomas O'Leary-Roseberry, Prashant K. Jha et al.
We explore using neural operators, or neural network representations of nonlinear maps between function spaces, to accelerate infinite-dimensional Bayesian inverse problems (BIPs) with models governed by nonlinear parametric partial differential equations (PDEs). Neural operators have gained significant attention in recent years for their ability to approximate the parameter-to-solution maps defined by PDEs using as training data solutions of PDEs at a limited number of parameter samples. The computational cost of BIPs can be drastically reduced if the large number of PDE solves required for posterior characterization are replaced with evaluations of trained neural operators. However, reducing error in the resulting BIP solutions via reducing the approximation error of the neural operators in training can be challenging and unreliable. We provide an a priori error bound result that implies certain BIPs can be ill-conditioned to the approximation error of neural operators, thus leading to inaccessible accuracy requirements in training. To reliably deploy neural operators in BIPs, we consider a strategy for enhancing the performance of neural operators, which is to correct the prediction of a trained neural operator by solving a linear variational problem based on the PDE residual. We show that a trained neural operator with error correction can achieve a quadratic reduction of its approximation error, all while retaining substantial computational speedups of posterior sampling when models are governed by highly nonlinear PDEs. The strategy is applied to two numerical examples of BIPs based on a nonlinear reaction--diffusion problem and deformation of hyperelastic materials. We demonstrate that posterior representations of the two BIPs produced using trained neural operators are greatly and consistently enhanced by error correction.
1.2NAMar 3, 2019
Finite element convergence for state-based peridynamic fracture modelsPrashant K. Jha, Robert Lipton
We establish the a-priori convergence rate for finite element approximations of a class of nonlocal nonlinear fracture models. We consider state based peridynamic models where the force at a material point is due to both the strain between two points and the change in volume inside the domain of nonlocal interaction. The pairwise interactions between points are mediated by a bond potential of multi-well type while multi point interactions are associated with volume change mediated by a hydrostatic strain potential. The hydrostatic potential can either be a quadratic function, delivering a linear force-strain relation, or a multi-well type that can be associated with material degradation and cavitation. We first show the well-posedness of the peridynamic formulation and that peridynamic evolutions exist in the Sobolev space $H^2$. We show that the finite element approximations converge to the $H^2$ solutions uniformly as measured in the mean square norm. For linear continuous finite elements the convergence rate is shown to be $C_t Δt + C_s h^2/ε^2$, where $ε$ is the size of horizon, $h$ is the mesh size, and $Δt$ is the size of time step. The constants $C_t$ and $C_s$ are independent of $Δt$ and $h$ and may depend on $ε$ through the norm of the exact solution. We demonstrate the stability of the semi-discrete approximation. The stability of the fully discrete approximation is shown for the linearized peridynamic force. We present numerical simulations with dynamic crack propagation that support the theoretical convergence rate.
5.9NAJun 21, 2023
Residual-Based Error Corrector Operator to Enhance Accuracy and Reliability of Neural Operator Surrogates of Nonlinear Variational Boundary-Value ProblemsPrashant K. Jha
This work focuses on developing methods for approximating the solution operators of a class of parametric partial differential equations via neural operators. Neural operators have several challenges, including the issue of generating appropriate training data, cost-accuracy trade-offs, and nontrivial hyperparameter tuning. The unpredictability of the accuracy of neural operators impacts their applications in downstream problems of inference, optimization, and control. A framework based on the linear variational problem that gives the correction to the prediction furnished by neural operators is considered based on earlier work in JCP 486 (2023) 112104. The operator, called Residual-based Error Corrector Operator or simply Corrector Operator, associated with the corrector problem is analyzed further. Numerical results involving a nonlinear reaction-diffusion model in two dimensions with PCANet-type neural operators show almost two orders of increase in the accuracy of approximations when neural operators are corrected using the correction scheme. Further, topology optimization involving a nonlinear reaction-diffusion model is considered to highlight the limitations of neural operators and the efficacy of the correction scheme. Optimizers with neural operator surrogates are seen to make significant errors (as high as 80 percent). However, the errors are much lower (below 7 percent) when neural operators are corrected.
1.2NAOct 2, 2018
Finite element approximation of nonlocal fracture modelsPrashant K. Jha, Robert Lipton
We consider nonlocal nonlinear potentials and estimate the rate of convergence of time stepping schemes to the peridynamic equation of motion. We begin by establishing the existence of $H^2$ solutions over any finite time interval. Here spatial approximation by finite element interpolations are considered. The energy stability of the associated semi-discrete time stepping scheme is established and the approximation of strong and weak formulations of the evolution using FE interpolations of $H^2$ solutions are investigated. The strong and weak form of approximations are shown to converge to the actual solution in the mean square norm at the rate $C_tΔt +C_s h^2/ε^2$ where $h$ is the mesh size, $ε$ is the size of nonlocal interaction and $Δt$ is the time step. The constants $C_t$ and $C_s$ are independent of $Δt$, and $h$. In the absence of nonlinearity a CFL like condition for the energy stability of the central difference time discretization scheme is developed.