Robust Deep FOSLS for Transmission Problems
For researchers solving PDEs with discontinuous coefficients, this provides a more robust loss formulation that maintains accuracy under high material contrast, addressing a known weakness of standard neural network methods.
The paper introduces a weighted FOSLS deep learning framework for transmission problems in heterogeneous media, proving equivalence to the natural energy norm and passive variance reduction. Numerical experiments show robust performance under high material contrast, mitigating overshoots in discontinuous scenarios.
This work presents a robust, energy-based deep learning framework for solving transmission problems in heterogeneous media, including cases with discontinuous material scenarios. We introduce a weighted First-Order System Least-Squares (FOSLS) formulation involving an energy-norm Poincaré constant and prove its equivalence to a natural energy norm of the underlying equations, with constants independent of material parameters. As a result, the optimization landscape remains aligned with a meaningful error approximation even under high material contrast, where standard neural network losses often deteriorate. We further prove that the FOSLS formulation, together with its integral-loss representation, exhibits a passive variance reduction property, whereby the gradient variance progressively decreases as the loss diminishes, in contrast to methods such as VPINNs and Deep Ritz. From a numerical standpoint, we adopt a reduced-order perspective by constructing a low-dimensional space described by a neural network. The optimal coefficients are computed via a least-squares solver, and the space is subsequently improved through gradient-based updates. By selecting the activation function ReQU, the method mitigates the spurious overshoots typically observed in smooth networks when approximating discontinuities. Numerical experiments in 1D and 2D interface settings corroborate these findings.