Assessing the performance of correlation-based multi-fidelity neural emulators
This work addresses the problem of computational expense in high-fidelity modeling for researchers and practitioners in fields like uncertainty quantification, but it appears incremental as it focuses on assessing existing correlation-based methods rather than introducing a new paradigm.
This study tackled the challenge of making outer loop tasks like optimization tractable for computationally expensive models by developing multi-fidelity neural emulators that integrate limited high-fidelity data with abundant low-fidelity information, and it quantified performance gains by comparing multi-fidelity to single-fidelity approaches across various configurations.
Outer loop tasks such as optimization, uncertainty quantification or inference can easily become intractable when the underlying high-fidelity model is computationally expensive. Similarly, data-driven architectures typically require large datasets to perform predictive tasks with sufficient accuracy. A possible approach to mitigate these challenges is the development of multi-fidelity emulators, leveraging potentially biased, inexpensive low-fidelity information while correcting and refining predictions using scarce, accurate high-fidelity data. This study investigates the performance of multi-fidelity neural emulators, neural networks designed to learn the input-to-output mapping by integrating limited high-fidelity data with abundant low-fidelity model solutions. We investigate the performance of such emulators for low and high-dimensional functions, with oscillatory character, in the presence of discontinuities, for collections of models with equal and dissimilar parametrization, and for a possibly large number of potentially corrupted low-fidelity sources. In doing so, we consider a large number of architectural, hyperparameter, and dataset configurations including networks with a different amount of spectral bias (Multi-Layered Perceptron, Siren and Kolmogorov Arnold Network), various mechanisms for coordinate encoding, exact or learnable low-fidelity information, and for varying training dataset size. We further analyze the added value of the multi-fidelity approach by conducting equivalent single-fidelity tests for each case, quantifying the performance gains achieved through fusing multiple sources of information.