NAMay 3, 2017
Insights on aliasing driven instabilities for advection equations with application to Gauss-Lobatto discontinuous Galerkin methodsJuan Manzanero, Gonzalo Rubio, Esteban Ferrer et al.
We analyse instabilities due to aliasing errors when solving one dimensional non-constant advection speed equations and discuss means to alleviate these types of errors when using high order discontinuous Galerkin (DG) schemes. First, we compare analytical bounds for the continuous and discrete version of the PDEs. Whilst traditional $L^2$ norm energy bounds applied to the discrete PDE do not always predict the physical behaviour of the continuous version of the equation, more strict elliptic norm bounds correctly bound the behaviour of the continuous PDE. Having derived consistent bounds, we analyse the effectiveness of two stabilising techniques: over-integration and split form variations (conservative, non-conservative and skew-symmetric). Whilst the former is shown to not alleviate aliasing in general, the latter ensures an aliasing-free solution if the splitting form of the discrete PDE is consistent with the continuous equation. The success of split form de-aliasing is restricted to DG schemes with the summation-by-parts simultaneous-approximation-term (SBP-SAT) properties (e.g. DG with Gauss-Lobatto points). Numerical experiments are included to illustrate the theoretical findings.
NAJun 29, 2018
A p-Multigrid Strategy with Anisotropic p-Adaptation Based on Truncation Errors for High-Order Discontinuous Galerkin MethodsAndrés M. Rueda-Ramírez, Juan Manzanero, Esteban Ferrer et al.
High-order DG methods have become a popular technique in computational fluid dynamics because their accuracy increases spectrally in smooth solutions with the order of the approximation. However, their main drawback is that increasing the order also increases the computational cost. Several techniques have been introduced in the past to reduce this cost. On the one hand, local mesh adaptation strategies based on error estimation have been proposed to reduce the number of degrees of freedom while keeping a similar accuracy. On the other hand, multigrid solvers may accelerate time marching computations for a fixed number of degrees of freedom. In this paper, we combine both methods and present a novel anisotropic p-adaptation multigrid algorithm for steady-state problems that uses the multigrid scheme both as a solver and as an anisotropic error estimator. To achieve this, we show that a recently developed anisotropic truncation error estimator [\textit{Rueda-Ramírez et al., Truncation Error Estimation in the p-Anisotropic DGSEM, J. of Scientific Computing}] is perfectly suited to be performed inside the multigrid cycle with negligible extra cost. Furthermore, we introduce a multi-stage p-adaptation procedure which reduces the computational time when very accurate results are required. The proposed methods are tested for the compressible Navier-Stokes equations, where we investigate two cases: the 2D flow on a flat plate is studied to assess accuracy and computational cost of the algorithm, where a speed-up of 816 is achieved compared to the traditional explicit method; and the 3D flow around a sphere is simulated and used to test the anisotropic properties of the proposed method, where a speed-up of 152 is achieved compared to the explicit method. The proposed multi-stage procedure achieved a speed-up of 2.6 in comparison to the single-stage method in highly accurate simulations.
NAFeb 21, 2019
A free-energy stable nodal discontinuous Galerkin approximation with summation-by-parts property for the Cahn-Hilliard equationJuan Manzanero, Gonzalo Rubio, David A. Kopriva et al.
We present a nodal Discontinuous Galerkin (DG) scheme for the Cahn-Hilliard equation that satisfies the summation-by-parts simultaneous-approximation-term (SBP-SAT) property. The latter permits us to show that the discrete free-energy is bounded, and as a result, the scheme is provably stable. The scheme and the stability proof are presented for general curvilinear three-dimensional hexahedral meshes. We use the Bassi-Rebay 1 (BR1) scheme to compute interface fluxes, and an IMplicit-EXplicit (IMEX) scheme to integrate in time. Lastly, we test the theoretical findings numerically and present examples for two and three-dimensional problems.
NAMay 26, 2018
On the role of numerical dissipation in stabilising under-resolved turbulent simulations using discontinuous Galerkin methodsJuan Manzanero, Esteban Ferrer, Gonzalo Rubio et al.
We analyse numerical errors (dissipation and dispersion) introduced by the discretisation of inviscid and viscous terms in energy stable discontinuous Galerkin methods. First, we analyse these methods using a linear von Neumann analysis (for a linear advection-diffusion equation) to characterise their properties in wave-number space. Second, we validate these observations using the 3D Taylor-Green Vortex Navier-Stokes problem to assess transitional/turbulent flows. We show that the dissipation introduced by upwind Riemann solvers affects primarily high wave-numbers. This dissipation may be increased, through a penalty parameter, until a critical value. However, further augmentation of this parameter leads to a decrease of dissipation, reaching zero for very large values. Regarding the dissipation introduced by second order derivatives, we show that this dissipa- tion acts at low and medium wave-numbers (lower wave-numbers compared to upwind Riemann solvers). In addition, we analyse the Spectral Vanishing Viscosity (SVV) technique, previously used in continuous discretisations (e.g. Fourier), to find that with an appropriate kernel (which damps selected modes) it is possible to control the amount of dissipation introduced in the low and medium wave-number range. Combining these ideas, we finally propose a DG-SVV approach that uses a Smagorinsky model to compute the numerical viscosity. This DG-SVV approach is tested in an isotropic laminar/turbulent under-resolved scenario. Combining the SVV technique with a low dissipation Riemann solver, we obtain a scheme capable of maintaining low dissipation levels for laminar flows, whilst providing the correct dissipation for all wave-number ranges in turbulent regimes.
NAJun 21, 2018
Truncation Error Estimation in the p-Anisotropic Discontinuous Galerkin Spectral Element MethodAndrés M. Rueda-Ramírez, Gonzalo Rubio, Esteban Ferrer et al.
In the context of Discontinuous Galerkin Spectral Element Methods (DGSEM), $τ$-estimation has been successfully used for p-adaptation algorithms. This method estimates the truncation error of representations with different polynomial orders using the solution on a reference mesh of relatively high order. In this paper, we present a novel anisotropic truncation error estimator derived from the $τ$-estimation procedure for DGSEM. We exploit the tensor product basis properties of the numerical solution to design a method where the total truncation error is calculated as a sum of its directional components. We show that the new error estimator is cheaper to evaluate than previous implementations of the $τ$-estimation procedure and that it obtains more accurate extrapolations of the truncation error for representations of a higher order than the reference mesh. The robustness of the method allows performing the p-adaptation strategy with coarser reference solutions, thus further reducing the computational cost. The proposed estimator is validated using the method of manufactured solutions in a test case for the compressible Navier-Stokes equations.
LGJul 28, 2023
An unsupervised machine-learning-based shock sensor for high-order supersonic flow solversAndrés Mateo-Gabín, Kenza Tlales, Eusebio Valero et al.
We present a novel unsupervised machine-learning sock sensor based on Gaussian Mixture Models (GMMs). The proposed GMM sensor demonstrates remarkable accuracy in detecting shocks and is robust across diverse test cases with significantly less parameter tuning than other options. We compare the GMM-based sensor with state-of-the-art alternatives. All methods are integrated into a high-order compressible discontinuous Galerkin solver, where two stabilization approaches are coupled to the sensor to provide examples of possible applications. The Sedov blast and double Mach reflection cases demonstrate that our proposed sensor can enhance hybrid sub-cell flux-differencing formulations by providing accurate information of the nodes that require low-order blending. Besides, supersonic test cases including high Reynolds numbers showcase the sensor performance when used to introduce entropy-stable artificial viscosity to capture shocks, demonstrating the same effectiveness as fine-tuned state-of-the-art sensors. The adaptive nature and ability to function without extensive training datasets make this GMM-based sensor suitable for complex geometries and varied flow configurations. Our study reveals the potential of unsupervised machine-learning methods, exemplified by this GMM sensor, to improve the robustness and efficiency of advanced CFD codes.
LGDec 4, 2025
Reliable Statistical Guarantees for Conformal Predictors with Small DatasetsMiguel Sánchez-Domínguez, Lucas Lacasa, Javier de Vicente et al.
Surrogate models (including deep neural networks and other machine learning algorithms in supervised learning) are capable of approximating arbitrarily complex, high-dimensional input-output problems in science and engineering, but require a thorough data-agnostic uncertainty quantification analysis before these can be deployed for any safety-critical application. The standard approach for data-agnostic uncertainty quantification is to use conformal prediction (CP), a well-established framework to build uncertainty models with proven statistical guarantees that do not assume any shape for the error distribution of the surrogate model. However, since the classic statistical guarantee offered by CP is given in terms of bounds for the marginal coverage, for small calibration set sizes (which are frequent in realistic surrogate modelling that aims to quantify error at different regions), the potentially strong dispersion of the coverage distribution around its average negatively impacts the relevance of the uncertainty model's statistical guarantee, often obtaining coverages below the expected value, resulting in a less applicable framework. After providing a gentle presentation of uncertainty quantification for surrogate models for machine learning practitioners, in this paper we bridge the gap by proposing a new statistical guarantee that offers probabilistic information for the coverage of a single conformal predictor. We show that the proposed framework converges to the standard solution offered by CP for large calibration set sizes and, unlike the classic guarantee, still offers relevant information about the coverage of a conformal predictor for small data sizes. We validate the methodology in a suite of examples, and implement an open access software solution that can be used alongside common conformal prediction libraries to obtain uncertainty models that fulfil the new guarantee.
LGMar 30
FluidFlow: a flow-matching generative model for fluid dynamics surrogates on unstructured meshesDavid Ramos, Lucas Lacasa, Fermín Gutiérrez et al.
Computational fluid dynamics (CFD) provides high-fidelity simulations of fluid flows but remains computationally expensive for many-query applications. In recent years deep learning (DL) has been used to construct data-driven fluid-dynamic surrogate models. In this work we consider a different learning paradigm and embrace generative modelling as a framework for constructing scalable fluid-dynamics surrogate models. We introduce FluidFlow, a generative model based on conditional flow-matching, a recent alternative to diffusion models that learns deterministic transport maps between noise and data distributions. FluidFlow is specifically designed to operate directly on CFD data defined on both structured and unstructured meshes alike, without the needs to perform any mesh interpolation pre-processing and preserving geometric fidelity. We assess the capabilities of FluidFlow using two different core neural network architectures, a U-Net and diffusion transformer (DiT), and condition their learning on physically meaningful parameters. The methodology is validated on two benchmark problems of increasing complexity: prediction of pressure coefficients along an airfoil boundary across different operating conditions, and prediction of pressure and friction coefficients over a full three-dimensional aircraft geometry discretized on a large unstructured mesh. In both cases, FluidFlow outperform strong multilayer perceptron baselines, achieving significantly lower error metrics and improved generalisation across operating conditions. Notably, the transformer-based architecture enables scalable learning on large unstructured datasets while maintaining high predictive accuracy. These results demonstrate that flow-matching generative models provide an effective and flexible framework for surrogate modelling in fluid dynamics, with potential for realistic engineering and scientific applications.
LGFeb 11
On the Role of Consistency Between Physics and Data in Physics-Informed Neural NetworksNicolás Becerra-Zuniga, Lucas Lacasa, Eusebio Valero et al.
Physics-informed neural networks (PINNs) have gained significant attention as a surrogate modeling strategy for partial differential equations (PDEs), particularly in regimes where labeled data are scarce and physical constraints can be leveraged to regularize the learning process. In practice, however, PINNs are frequently trained using experimental or numerical data that are not fully consistent with the governing equations due to measurement noise, discretization errors, or modeling assumptions. The implications of such data-to-PDE inconsistencies on the accuracy and convergence of PINNs remain insufficiently understood. In this work, we systematically analyze how data inconsistency fundamentally limits the attainable accuracy of PINNs. We introduce the concept of a consistency barrier, defined as an intrinsic lower bound on the error that arises from mismatches between the fidelity of the data and the exact enforcement of the PDE residual. To isolate and quantify this effect, we consider the 1D viscous Burgers equation with a manufactured analytical solution, which enables full control over data fidelity and residual errors. PINNs are trained using datasets of progressively increasing numerical accuracy, as well as perfectly consistent analytical data. Results show that while the inclusion of the PDE residual allows PINNs to partially mitigate low-fidelity data and recover the dominant physical structure, the training process ultimately saturates at an error level dictated by the data inconsistency. When high-fidelity numerical data are employed, PINN solutions become indistinguishable from those trained on analytical data, indicating that the consistency barrier is effectively removed. These findings clarify the interplay between data quality and physics enforcement in PINNs providing practical guidance for the construction and interpretation of physics-informed surrogate models.
IVNov 25, 2024
EigenHearts: Cardiac Diseases Classification Using EigenFaces ApproachNourelhouda Groun, Maria Villalba-Orero, Lucia Casado-Martin et al.
In the realm of cardiovascular medicine, medical imaging plays a crucial role in accurately classifying cardiac diseases and making precise diagnoses. However, the field faces significant challenges when integrating data science techniques, as a significant volume of images is required for these techniques. As a consequence, it is necessary to investigate different avenues to overcome this challenge. In this contribution, we offer an innovative tool to conquer this limitation. In particular, we delve into the application of a well recognized method known as the EigenFaces approach to classify cardiac diseases. This approach was originally motivated for efficiently representing pictures of faces using principal component analysis, which provides a set of eigenvectors (aka eigenfaces), explaining the variation between face images. As this approach proven to be efficient for face recognition, it motivated us to explore its efficiency on more complicated data bases. In particular, we integrate this approach, with convolutional neural networks (CNNs) to classify echocardiography images taken from mice in five distinct cardiac conditions (healthy, diabetic cardiomyopathy, myocardial infarction, obesity and TAC hypertension). Performing a preprocessing step inspired from the eigenfaces approach on the echocardiography datasets, yields sets of pod modes, which we will call eigenhearts. To demonstrate the proposed approach, we compare two testcases: (i) supplying the CNN with the original images directly, (ii) supplying the CNN with images projected into the obtained pod modes. The results show a substantial and noteworthy enhancement when employing SVD for pre-processing, with classification accuracy increasing by approximately 50%.
LGMay 5, 2025
Transfer learning-enhanced deep reinforcement learning for aerodynamic airfoil optimisation subject to structural constraintsDavid Ramos, Lucas Lacasa, Eusebio Valero et al.
The main objective of this paper is to introduce a transfer learning-enhanced deep reinforcement learning (DRL) methodology that is able to optimise the geometry of any airfoil based on concomitant aerodynamic and structural integrity criteria. To showcase the method, we aim to maximise the lift-to-drag ratio $C_L/C_D$ while preserving the structural integrity of the airfoil -- as modelled by its maximum thickness -- and train the DRL agent using a list of different transfer learning (TL) strategies. The performance of the DRL agent is compared with Particle Swarm Optimisation (PSO), a traditional gradient-free optimisation method. Results indicate that DRL agents are able to perform purely aerodynamic and hybrid aerodynamic/structural shape optimisation, that the DRL approach outperforms PSO in terms of computational efficiency and aerodynamic improvement, and that the TL-enhanced DRL agent achieves performance comparable to the DRL one, while further saving substantial computational resources.
LGNov 4, 2024
Towards certification: A complete statistical validation pipeline for supervised learning in industryLucas Lacasa, Abel Pardo, Pablo Arbelo et al.
Methods of Machine and Deep Learning are gradually being integrated into industrial operations, albeit at different speeds for different types of industries. The aerospace and aeronautical industries have recently developed a roadmap for concepts of design assurance and integration of neural network-related technologies in the aeronautical sector. This paper aims to contribute to this paradigm of AI-based certification in the context of supervised learning, by outlining a complete validation pipeline that integrates deep learning, optimization and statistical methods. This pipeline is composed by a directed graphical model of ten steps. Each of these steps is addressed by a merging key concepts from different contributing disciplines (from machine learning or optimization to statistics) and adapting them to an industrial scenario, as well as by developing computationally efficient algorithmic solutions. We illustrate the application of this pipeline in a realistic supervised problem arising in aerostructural design: predicting the likelikood of different stress-related failure modes during different airflight maneuvers based on a (large) set of features characterising the aircraft internal loads and geometric parameters.
LGSep 12, 2025
A Certifiable Machine Learning-Based Pipeline to Predict Fatigue Life of Aircraft StructuresÁngel Ladrón, Miguel Sánchez-Domínguez, Javier Rozalén et al.
Fatigue life prediction is essential in both the design and operational phases of any aircraft, and in this sense safety in the aerospace industry requires early detection of fatigue cracks to prevent in-flight failures. Robust and precise fatigue life predictors are thus essential to ensure safety. Traditional engineering methods, while reliable, are time consuming and involve complex workflows, including steps such as conducting several Finite Element Method (FEM) simulations, deriving the expected loading spectrum, and applying cycle counting techniques like peak-valley or rainflow counting. These steps often require collaboration between multiple teams and tools, added to the computational time and effort required to achieve fatigue life predictions. Machine learning (ML) offers a promising complement to traditional fatigue life estimation methods, enabling faster iterations and generalization, providing quick estimates that guide decisions alongside conventional simulations. In this paper, we present a ML-based pipeline that aims to estimate the fatigue life of different aircraft wing locations given the flight parameters of the different missions that the aircraft will be operating throughout its operational life. We validate the pipeline in a realistic use case of fatigue life estimation, yielding accurate predictions alongside a thorough statistical validation and uncertainty quantification. Our pipeline constitutes a complement to traditional methodologies by reducing the amount of costly simulations and, thereby, lowering the required computational and human resources.
IVNov 24, 2024
A Novel Data Augmentation Tool for Enhancing Machine Learning Classification: A New Application of the Higher Order Dynamic Mode Decomposition for Improved Cardiac Disease IdentificationNourelhouda Groun, Maria Villalba-Orero, Lucia Casado-Martin et al.
In this work, a data-driven, modal decomposition method, the higher order dynamic mode decomposition (HODMD), is combined with a convolutional neural network (CNN) in order to improve the classification accuracy of several cardiac diseases using echocardiography images. The HODMD algorithm is used first as feature extraction technique for the echocardiography datasets, taken from both healthy mice and mice afflicted by different cardiac diseases (Diabetic Cardiomyopathy, Obesity, TAC Hypertrophy and Myocardial Infarction). A total number of 130 echocardiography datasets are used in this work. The dominant features related to each cardiac disease were identified and represented by the HODMD algorithm as a set of DMD modes, which then are used as the input to the CNN. In a way, the database dimension was augmented, hence HODMD has been used, for the first time to the authors knowledge, for data augmentation in the machine learning framework. Six sets of the original echocardiography databases were hold out to be used as unseen data to test the performance of the CNN. In order to demonstrate the efficiency of the HODMD technique, two testcases are studied: the CNN is first trained using the original echocardiography images only, and second training the CNN using a combination of the original images and the DMD modes. The classification performance of the designed trained CNN shows that combining the original images with the DMD modes improves the results in all the testcases, as it improves the accuracy by up to 22%. These results show the great potential of using the HODMD algorithm as a data augmentation technique.