Blending Neural Operators and Relaxation Methods in PDE Numerical Solvers
This work addresses the challenge of efficient PDE solving for scientific computing, offering a novel hybrid approach that is incremental in integrating existing methods.
The paper tackled the problem of solving partial differential equations (PDEs) by combining neural operators and relaxation methods to overcome spectral bias and inefficiencies, resulting in a hybrid solver (HINTS) that achieves uniform convergence rates and scalability for large-scale systems.
Neural networks suffer from spectral bias having difficulty in representing the high frequency components of a function while relaxation methods can resolve high frequencies efficiently but stall at moderate to low frequencies. We exploit the weaknesses of the two approaches by combining them synergistically to develop a fast numerical solver of partial differential equations (PDEs) at scale. Specifically, we propose HINTS, a hybrid, iterative, numerical, and transferable solver by integrating a Deep Operator Network (DeepONet) with standard relaxation methods, leading to parallel efficiency and algorithmic scalability for a wide class of PDEs, not tractable with existing monolithic solvers. HINTS balances the convergence behavior across the spectrum of eigenmodes by utilizing the spectral bias of DeepONet, resulting in a uniform convergence rate and hence exceptional performance of the hybrid solver overall. Moreover, HINTS applies to large-scale, multidimensional systems, it is flexible with regards to discretizations, computational domain, and boundary conditions.