LGNov 29, 2022
FC-PINO: High Precision Physics-Informed Neural Operators via Fourier ContinuationAdarsh Ganeshram, Haydn Maust, Valentin Duruisseaux et al.
The physics-informed neural operator (PINO) is a machine learning paradigm that has demonstrated promising results for learning solutions to partial differential equations (PDEs). It leverages the Fourier Neural Operator to learn solution operators in function spaces and leverages physics losses during training to penalize deviations from known physics laws. Spectral differentiation provides an efficient way to compute derivatives for the physics losses, but it inherently assumes periodicity. When applied to non-periodic functions, this assumption can lead to significant errors, including Gibbs phenomena near domain boundaries which degrade the accuracy of both function representations and derivative computations. To overcome this limitation, we introduce the FC-PINO (Fourier-Continuation-based Physics-Informed Neural Operator) architecture which extends the accuracy and efficiency of PINO and spectral differentiation to non-periodic and non-smooth PDEs. In FC-PINO, we propose integrating Fourier continuation into the PINO framework, and test two different continuation approaches: FC-Legendre and FC-Gram. By transforming non-periodic signals into periodic functions on extended domains in a well-conditioned manner, Fourier continuation enables fast and accurate derivative computations. This approach avoids the discretization sensitivity of finite differences and the memory overhead of automatic differentiation. We demonstrate that standard PINO fails (without padding) or struggles (even with padding) to solve non-periodic and non-smooth PDEs with high precision, across challenging benchmarks. In contrast, the proposed FC-PINO provides accurate, robust, and scalable solutions, substantially outperforming PINO alternatives, and demonstrating that Fourier continuation is critical for extending PINO to a wider range of PDE problems when high-precision solutions are needed.
NAMar 27, 2017
Regularity theory and high order numerical methods for the (1d)-Fractional LaplacianGabriel Acosta, Juan Pablo Borthagaray, Oscar Bruno et al.
This paper presents regularity results and associated high-order numerical methods for one-dimensional Fractional-Laplacian boundary-value problems. On the basis of a factorization of solutions as a product of a certain edge-singular weight $ω$ times a "regular" unknown, a characterization of the regularity of solutions is obtained in terms of the smoothness of the corresponding right-hand sides. In particular, for right-hand sides which are analytic in a Bernstein Ellipse, analyticity in the same Bernstein Ellipse is obtained for the "regular" unknown. Moreover, a sharp Sobolev regularity result is presented which completely characterizes the co-domain of the Fractional-Laplacian operator in terms of certain weighted Sobolev spaces introduced in (Babuška and Guo, SIAM J. Numer. Anal. 2002). The present theoretical treatment relies on a full eigendecomposition for a certain weighted integral operator in terms of the Gegenbauer polynomial basis. The proposed Gegenbauer-based Nyström numerical method for the Fractional-Laplacian Dirichlet problem, further, is significantly more accurate and efficient than other algorithms considered previously. The sharp error estimates presented in this paper indicate that the proposed algorithm is spectrally accurate, with convergence rates that only depend on the smoothness of the right-hand side. In particular, convergence is exponentially fast (resp. faster than any power of the mesh-size) for analytic (resp. in nitely smooth) right-hand sides. The properties of the algorithm are illustrated with a variety of numerical results.
NAOct 17, 2016
Windowed Green Function Method for Nonuniform Open-Waveguide ProblemsOscar Bruno, Emmanuel Garza, Carlos Perez-Arancibia
This contribution presents a novel Windowed Green Function (WGF) method for the solution of problems of wave propagation, scattering and radiation for structures which include open (dielectric) waveguides, waveguide junctions, as well as launching and/or termination sites and other nonuniformities. Based on use of a "slow-rise" smooth-windowing technique in conjunction with free-space Green functions and associated integral representations, the proposed approach produces numerical solutions with errors that decrease faster than any negative power of the window size. The proposed methodology bypasses some of the most significant challenges associated with waveguide simulation. In particular the WGF approach handles spatially-infinite dielectric waveguide structures without recourse to absorbing boundary conditions, it facilitates proper treatment of complex geometries, and it seamlessly incorporates the open-waveguide character and associated radiation conditions inherent in the problem under consideration. The overall WGF approach is demonstrated in this paper by means of a variety of numerical results for two-dimensional open-waveguide termination, launching and junction problems.
COMP-PHMay 23, 2018
Shifted Equivalent Sources and FFT acceleration for Periodic Scattering Problems including Wood AnomaliesOscar Bruno, Martín Maas
This paper introduces a fast algorithm, applicable throughout the electromagnetic spectrum, for the numerical solution of problems of scattering by periodic surfaces in two-dimensional space. The proposed algorithm remains highly accurate and efficient for challenging configurations including randomly rough surfaces, deep corrugations, large periods, near grazing incidences, and, importantly, Wood-anomaly resonant frequencies. The proposed approach is based on use of certain `shifted equivalent sources' which enable FFT acceleration of a Wood-anomaly-capable quasi-periodic Green function introduced recently (Bruno and Delourme, Jour. Computat. Phys., 262--290, 2014). The Green-function strategy additionally incorporates an exponentially convergent shifted version of the classical spectral series for the Green function. While the computing-cost asymptotics depend on the asymptotic configuration assumed, the computing costs rise at most linearly with the size of the problem for a number of important rough-surface cases we consider. In practice, single-core runs in computing times ranging from a fraction of a second to a few seconds suffice for the proposed algorithm to produce highly-accurate solutions in some of the most challenging contexts arising in applications.
COMP-PHSep 30, 2015
On the quasi-unconditional stability of BDF-ADI solvers for the compressible Navier-Stokes equationsOscar Bruno, Max Cubillos
The companion paper "Higher-order in time quasi-unconditionally stable ADI solvers for the compressible Navier-Stokes equations in 2D and 3D curvilinear domains", which is referred to as Part I in what follows, introduces ADI (Alternating Direction Implicit) solvers of higher orders of temporal accuracy (orders $s = 2$ to $6$) for the compressible Navier-Stokes equations in two- and three-dimensional space. The proposed methodology employs the backward differentiation formulae (BDF) together with a quasilinear-like formulation, high-order extrapolation for nonlinear components, and the Douglas-Gunn splitting. A variety of numerical results presented in Part I demonstrate in practice the theoretical convergence rates enjoyed by these algorithms, as well as their excellent accuracy and stability properties for a wide range of Reynolds numbers. In particular, the proposed schemes enjoy a certain property of "quasi-unconditional stability": for small enough (problem-dependent) fixed values of the time-step $Δt$, these algorithms are stable for arbitrarily fine spatial discretizations. The present contribution presents a mathematical basis for the performance of these algorithms. Short of providing stability theorems for the full BDF-ADI Navier-Stokes solvers, this paper puts forth proofs of unconditional stability and quasi-unconditional stability for BDF-ADI schemes as well as some related un-split BDF schemes, for a variety of related linear model problems in one, two and three spatial dimensions, and for schemes of orders $2\leq s\leq 6$ of temporal accuracy. Additionally, a set of numerical tests presented in this paper for the compressible Navier-Stokes equation indicate that quasi-unconditional stability carries over to the fully non-linear context.
COMP-PHSep 30, 2015
Higher-order in time "quasi-unconditionally stable" ADI solvers for the compressible Navier-Stokes equations in 2D and 3D curvilinear domainsOscar Bruno, Max Cubillos
This paper introduces alternating-direction implicit (ADI) solvers of higher order of time-accuracy (orders two to six) for the compressible Navier-Stokes equations in two- and three-dimensional curvilinear domains. The higher-order accuracy in time results from 1) An application of the backward differentiation formulae time-stepping algorithm (BDF) in conjunction with 2) A BDF-like extrapolation technique for certain components of the nonlinear terms (which makes use of nonlinear solves unnecessary), as well as 3) A novel application of the Douglas-Gunn splitting (which greatly facilitates handling of boundary conditions while preserving higher-order accuracy in time). As suggested by our theoretical analysis of the algorithms for a variety of special cases, an extensive set of numerical experiments clearly indicate that all of the BDF-based ADI algorithms proposed in this paper are "quasi-unconditionally stable" in the following sense: each algorithm is stable for all couples $(h,Δt)$ of spatial and temporal mesh sizes in a problem-dependent rectangular neighborhood of the form $(0,M_h)\times (0,M_t)$. In other words, for each fixed value of $Δt$ below a certain threshold, the Navier-Stokes solvers presented in this paper are stable for arbitrarily small spatial mesh-sizes. The second order formulation has further been rigorously shown to be unconditionally stable for linear hyperbolic and parabolic equations in two-dimensional space. Although implicit ADI solvers for the Navier-Stokes equations with nominal second-order of temporal accuracy have been proposed in the past, the algorithms presented in this paper are the first ADI-based Navier-Stokes solvers for which second order or better accuracy has been verified in practice under non-trivial (non-periodic) boundary conditions.
NANov 1, 2014
A boundary integral algorithm for the Laplace Dirichlet-Neumann mixed eigenvalue problemEldar Akhmetgaliyev, Oscar Bruno, Nilima Nigam
We present a novel integral-equation algorithm for evaluation of Zaremba eigenvalues and eigenfunctions}, that is, eigenvalues and eigenfunctions of the Laplace operator with mixed Dirichlet-Neumann boundary conditions; of course, (slight modifications of) our algorithms are also applicable to the pure Dirichlet and Neumann eigenproblems. Expressing the eigenfunctions by means of an ansatz based on the single layer boundary operator, the Zaremba eigenproblem is transformed into a nonlinear equation for the eigenvalue $μ$. For smooth domains the singular structure at Dirichlet-Neumann junctions is incorporated as part of our corresponding numerical algorithm---which otherwise relies on use of the cosine change of variables, trigonometric polynomials and, to avoid the Gibbs phenomenon that would arise from the solution singularities, the Fourier Continuation method (FC). The resulting numerical algorithm converges with high order accuracy without recourse to use of meshes finer than those resulting from the cosine transformation. For non-smooth (Lipschitz) domains, in turn, an alternative algorithm is presented which achieves high-order accuracy on the basis of graded meshes. In either case, smooth or Lipschitz boundary, eigenvalues are evaluated by searching for zero minimal singular values of a suitably stabilized discrete version of the single layer operator mentioned above. (The stabilization technique is used to enable robust non-local zero searches.) The resulting methods, which are fast and highly accurate for high- and low-frequencies alike, can solve extremely challenging two-dimensional Dirichlet, Neumann and Zaremba eigenproblems with high accuracies in short computing times---enabling, in particular, evaluation of thousands of eigenvalues and corresponding eigenfunctions for a given smooth or non-smooth geometry with nearly full double-precision accuracy