Gianluigi Rozza

Nicola Demo, Marco Tezzele, Andrea Mola et al.

In this contribution, we present the results of the application of a parameter space reduction methodology based on active subspaces to the hull hydrodynamic design problem. Several parametric deformations of an initial hull shape are considered to assess the influence of the shape parameters considered on the hull total drag. The hull resistance is typically computed by means of numerical simulations of the hydrodynamic flow past the ship. Given the high number of parameters involved - which might result in a high number of time consuming hydrodynamic simulations - assessing whether the parameters space can be reduced would lead to considerable computational cost reduction. Thus, the main idea of this work is to employ the active subspaces to identify possible lower dimensional structures in the parameter space, or to verify the parameter distribution in the position of the control points. To this end, a fully automated procedure has been implemented to produce several small shape perturbations of an original hull CAD geometry which are then used to carry out high-fidelity flow simulations and collect data for the active subspaces analysis. To achieve full automation of the open source pipeline described, both the free form deformation methodology employed for the hull perturbations and the solver based on unsteady potential flow theory, with fully nonlinear free surface treatment, are directly interfaced with CAD data structures and operate using IGES vendor-neutral file formats as input files. The computational cost of the fluid dynamic simulations is further reduced through the application of dynamic mode decomposition to reconstruct the steady state total drag value given only few initial snapshots of the simulation. The active subspaces analysis is here applied to the geometry of the DTMB-5415 naval combatant hull, which is a common benchmark in ship hydrodynamics simulations.

Giovanni Stabile, Gianluigi Rozza

In this work a stabilised and reduced Galerkin projection of the incompressible unsteady Navier-Stokes equations for moderate Reynolds number is presented. The full-order model, on which the Galerkin projection is applied, is based on a finite volumes approximation. The reduced basis spaces are constructed with a POD approach. Two different pressure stabilisation strategies are proposed and compared: the former one is based on the supremizer enrichment of the velocity space, and the latter one is based on a pressure Poisson equation approach.

F. Salmoiraghi, A. Scardigli, H. Telib et al.

The work provides an integrated pipeline for the model order reduction of turbulent flows around parametrised geometries in aerodynamics. In particular, Free-Form Deformation is applied for geometry parametrisation, whereas two different reduced-order models based on Proper Orthogonal Decomposition (POD) are employed in order to speed-up the full-order simulations: the first method exploits POD with interpolation, while the second one is based on domain decomposition. For the sampling of the parameter space, we adopt a Greedy strategy coupled with Constrained Centroidal Voronoi Tessellations, in order to guarantee a good compromise between space exploration and exploitation. The proposed framework is tested on an industrially relevant application, i.e. the front-bumper morphing of the DrivAer car model, using the finite-volume method for the full-order resolution of the Reynolds-Averaged Navier-Stokes equations.

Gianluigi Rozza, Haris Malik, Nicola Demo et al.

Reduced order modeling has gained considerable attention in recent decades owing to the advantages offered in reduced computational times and multiple solutions for parametric problems. The focus of this manuscript is the application of model order reduction techniques in various engineering and scientific applications including but not limited to mechanical, naval and aeronautical engineering. The focus here is kept limited to computational fluid mechanics and related applications. The advances in the reduced order modeling with proper orthogonal decomposition and reduced basis method are presented as well as a brief discussion of dynamic mode decomposition and also some present advances in the parameter space reduction. Here, an overview of the challenges faced and possible solutions are presented with examples from various problems.

Nicola Demo, Marco Tezzele, Gianluca Gustin et al.

Shape optimization is a challenging task in many engineering fields, since the numerical solutions of parametric system may be computationally expensive. This work presents a novel optimization procedure based on reduced order modeling, applied to a naval hull design problem. The advantage introduced by this method is that the solution for a specific parameter can be expressed as the combination of few numerical solutions computed at properly chosen parametric points. The reduced model is built using the proper orthogonal decomposition with interpolation (PODI) method. We use the free form deformation (FFD) for an automated perturbation of the shape, and the finite volume method to simulate the multiphase incompressible flow around the deformed hulls. Further computational reduction is done by the dynamic mode decomposition (DMD) technique: from few high dimensional snapshots, the system evolution is reconstructed and the final state of the simulation is faithfully approximated. Finally the global optimization algorithm iterates over the reduced space: the approximated drag and lift coefficients are projected to the hull surface, hence the resistance is evaluated for the new hulls until the convergence to the optimal shape is achieved. We will present the results obtained applying the described procedure to a typical Fincantieri cruise ship.

Nicola Demo, Marco Tezzele, Gianluigi Rozza

In the present work, we introduce a novel approach to enhance the precision of reduced order models by exploiting a multi-fidelity perspective and DeepONets. Reduced models provide a real-time numerical approximation by simplifying the original model. The error introduced by the such operation is usually neglected and sacrificed in order to reach a fast computation. We propose to couple the model reduction to a machine learning residual learning, such that the above-mentioned error can be learned by a neural network and inferred for new predictions. We emphasize that the framework maximizes the exploitation of high-fidelity information, using it for building the reduced order model and for learning the residual. In this work, we explore the integration of proper orthogonal decomposition (POD), and gappy POD for sensors data, with the recent DeepONet architecture. Numerical investigations for a parametric benchmark function and a nonlinear parametric Navier-Stokes problem are presented.

Francesco Romor, Giovanni Stabile, Gianluigi Rozza

Non-affine parametric dependencies, nonlinearities and advection-dominated regimes of the model of interest can result in a slow Kolmogorov n-width decay, which precludes the realization of efficient reduced-order models based on linear subspace approximations. Among the possible solutions, there are purely data-driven methods that leverage autoencoders and their variants to learn a latent representation of the dynamical system, and then evolve it in time with another architecture. Despite their success in many applications where standard linear techniques fail, more has to be done to increase the interpretability of the results, especially outside the training range and not in regimes characterized by an abundance of data. Not to mention that none of the knowledge on the physics of the model is exploited during the predictive phase. In order to overcome these weaknesses, we implement the non-linear manifold method introduced by Carlberg et al [37] with hyper-reduction achieved through reduced over-collocation and teacher-student training of a reduced decoder. We test the methodology on a 2d non-linear conservation law and a 2d shallow water models, and compare the results obtained with a purely data-driven method for which the dynamics is evolved in time with a long-short term memory network.

Martin Hess, Gianluigi Rozza

We consider the Navier-Stokes equations in a channel with varying Reynolds numbers. The model is discretized with high-order spectral element ansatz functions, resulting in 14 259 degrees of freedom. The steady-state snapshot solu- tions define a reduced order space, which allows to accurately evaluate the steady- state solutions for varying Reynolds number with a reduced order model within a fixed-point iteration. In particular, we compare different aspects of implementing the reduced order model with respect to the use of a spectral element discretization. It is shown, how a multilevel static condensation [1] in the pressure and velocity boundary degrees of freedom can be combined with a reduced order modelling approach to enhance computational times in parametric many-query scenarios.

Dario Coscia, Laura Meneghetti, Nicola Demo et al.

Convolutional Neural Network (CNN) is one of the most important architectures in deep learning. The fundamental building block of a CNN is a trainable filter, represented as a discrete grid, used to perform convolution on discrete input data. In this work, we propose a continuous version of a trainable convolutional filter able to work also with unstructured data. This new framework allows exploring CNNs beyond discrete domains, enlarging the usage of this important learning technique for many more complex problems. Our experiments show that the continuous filter can achieve a level of accuracy comparable to the state-of-the-art discrete filter, and that it can be used in current deep learning architectures as a building block to solve problems with unstructured domains as well.

Anna Ivagnes, Nicola Demo, Gianluigi Rozza

In this work, we propose a model order reduction framework to deal with inverse problems in a non-intrusive setting. Inverse problems, especially in a partial differential equation context, require a huge computational load due to the iterative optimization process. To accelerate such a procedure, we apply a numerical pipeline that involves artificial neural networks to parametrize the boundary conditions of the problem in hand, compress the dimensionality of the (full-order) snapshots, and approximate the parametric solution manifold. It derives a general framework capable to provide an ad-hoc parametrization of the inlet boundary and quickly converges to the optimal solution thanks to model order reduction. We present in this contribution the results obtained by applying such methods to two different CFD test cases.

Dinh Bao Phuong Huynh, Federico Pichi, Gianluigi Rozza

In this work we consider (hierarchical, Lagrange) reduced basis approximation and a posteriori error estimation for elasticity problems in affinley parametrized geometries. The essential ingredients of the methodology are: a Galerkin projection onto a low-dimensional space associated with a smooth "parametric manifold" - dimension reduction, an efficient and effective greedy sampling methods for identification of optimal and numerically stable approximations - rapid convergence, an a posteriori error estimation procedures - rigorous and sharp bounds for the functional outputs related with the underlying solution or related quantities of interest, like stress intensity factor, and Offline-Online computational decomposition strategies - minimum marginal cost for high performance in the real-time and many-query (e.g., design and optimization) contexts. We present several illustrative results for linear elasticity problem in parametrized geometries representing 2D Cartesian or 3D axisymmetric configurations like an arc-cantilever beam, a center crack problem, a composite unit cell or a woven composite beam, a multi-material plate, and a closed vessel. We consider different parametrization for the systems: either physical quantities - to model the materials and loads - and geometrical parameters - to model different geometrical configurations - with isotropic and orthotropic materials working in plane stress and plane strain approximation. We would like to underline the versatility of the methodology in very different problems. As last example we provide a nonlinear setting with increased complexity.

Sajad Salavatidezfouli, Giovanni Stabile, Gianluigi Rozza

This research study explores the applicability of Deep Reinforcement Learning (DRL) for thermal control based on Computational Fluid Dynamics. To accomplish that, the forced convection on a hot plate prone to a pulsating cooling jet with variable velocity has been investigated. We begin with evaluating the efficiency and viability of a vanilla Deep Q-Network (DQN) method for thermal control. Subsequently, a comprehensive comparison between different variants of DRL is conducted. Soft Double and Duel DQN achieved better thermal control performance among all the variants due to their efficient learning and action prioritization capabilities. Results demonstrate that the soft Double DQN outperforms the hard Double DQN. Moreover, soft Double and Duel can maintain the temperature in the desired threshold for more than 98% of the control cycle. These findings demonstrate the promising potential of DRL in effectively addressing thermal control systems.

Denis Devaud, Gianluigi Rozza

In this work we apply reduced basis methods for parametric PDEs to an isogeometric formulation based on NURBS. The motivation for this work is an integrated and complete work pipeline from CAD to parametrization of domain geometry, then from full order to certified reduced basis solution. IsoGeometric Analysis (IGA) is a growing research theme in scientific computing and computational mechanics, as well as reduced basis methods for parametric PDEs. Their combination enhances the solution of some class of problems, especially the ones characterized by parametrized geometries we introduced in this work. This work wants to demonstrate that it is also possible for some class of problems to deal with affine geometrical parametrization combined with a NURBS IGA formulation. This is what this work brings as original ingredients with respect to other works dealing with reduced order methods and IGA. In this work we show a certification of accuracy and a complete integration between IGA formulation and parametric certified greedy RB formulation.

Ferdinando Auricchio, Michele Conti, Adrian Lefieux et al.

The introduction of computational models in cardiovascular sciences has been progressively bringing new and unique tools for the investigation of the physiopathology. Together with the dramatic improvement of imaging and measuring devices on one side, and of computational architectures on the other one, mathematical and numerical models have provided a new, clearly noninvasive, approach for understanding not only basic mechanisms but also patient-specific conditions, and for supporting the design and the development of new therapeutic options. The terminology in silico is, nowadays, commonly accepted for indicating this new source of knowledge added to traditional in vitro and in vivo investigations. The advantages of in silico methodologies are basically the low cost in terms of infrastructures and facilities, the reduced invasiveness and, in general, the intrinsic predictive capabilities based on the use of mathematical models. The disadvantages are generally identified in the distance between the real cases and their virtual counterpart required by the conceptual modeling that can be detrimental for the reliability of numerical simulations.

Moaad Khamlich, Federico Pichi, Gianluigi Rozza

Reduced order models (ROMs) are widely used in scientific computing to tackle high-dimensional systems. However, traditional ROM methods may only partially capture the intrinsic geometric characteristics of the data. These characteristics encompass the underlying structure, relationships, and essential features crucial for accurate modeling. To overcome this limitation, we propose a novel ROM framework that integrates optimal transport (OT) theory and neural network-based methods. Specifically, we investigate the Kernel Proper Orthogonal Decomposition (kPOD) method exploiting the Wasserstein distance as the custom kernel, and we efficiently train the resulting neural network (NN) employing the Sinkhorn algorithm. By leveraging an OT-based nonlinear reduction, the presented framework can capture the geometric structure of the data, which is crucial for accurate learning of the reduced solution manifold. When compared with traditional metrics such as mean squared error or cross-entropy, exploiting the Sinkhorn divergence as the loss function enhances stability during training, robustness against overfitting and noise, and accelerates convergence. To showcase the approach's effectiveness, we conduct experiments on a set of challenging test cases exhibiting a slow decay of the Kolmogorov n-width. The results show that our framework outperforms traditional ROM methods in terms of accuracy and computational efficiency.

Toni Lassila, Gianluigi Rozza

We propose a two-fold approach to model reduction of fluid-structure interaction. The state equations for the fluid are solved with reduced basis methods. These are model reduction methods for parametric partial differential equations using well-chosen snapshot solutions in order to build a set of global basis functions. The other reduction is in terms of the geometric complexity of the moving fluid-structure interface. We use free-form deformations to parameterize the perturbation of the flow channel at rest configuration. As a computational example we consider a steady fluid-structure interaction problem: an incmpressible Stokes flow in a channel that has a flexible wall.

Isabella Carla Gonnella, Martin W. Hess, Giovanni Stabile et al.

Parametric time-dependent systems are of a crucial importance in modeling real phenomena, often characterized by non-linear behaviors too. Those solutions are typically difficult to generalize in a sufficiently wide parameter space while counting on limited computational resources available. As such, we present a general two-stages deep learning framework able to perform that generalization with low computational effort in time. It consists in a separated training of two pipe-lined predictive models. At first, a certain number of independent neural networks are trained with data-sets taken from different subsets of the parameter space. Successively, a second predictive model is specialized to properly combine the first-stage guesses and compute the right predictions. Promising results are obtained applying the framework to incompressible Navier-Stokes equations in a cavity (Rayleigh-Bernard cavity), obtaining a 97% reduction in the computational time comparing with its numerical resolution for a new value of the Grashof number.

Laura Meneghetti, Nicola Demo, Gianluigi Rozza

As a major breakthrough in artificial intelligence and deep learning, Convolutional Neural Networks have achieved an impressive success in solving many problems in several fields including computer vision and image processing. Real-time performance, robustness of algorithms and fast training processes remain open problems in these contexts. In addition object recognition and detection are challenging tasks for resource-constrained embedded systems, commonly used in the industrial sector. To overcome these issues, we propose a dimensionality reduction framework based on Proper Orthogonal Decomposition, a classical model order reduction technique, in order to gain a reduction in the number of hyperparameters of the net. We have applied such framework to SSD300 architecture using PASCAL VOC dataset, demonstrating a reduction of the network dimension and a remarkable speedup in the fine-tuning of the network in a transfer learning context.

Gabriele Codega, Anna Ivagnes, Nicola Demo et al.

In the present work, we introduce a data-driven approach to enhance the accuracy of non-intrusive Reduced Order Models (ROMs). In particular, we focus on ROMs built using Proper Orthogonal Decomposition (POD) in an under-resolved and marginally-resolved regime, i.e. when the number of modes employed is not enough to capture the system dynamics. We propose a method to re-introduce the contribution of neglected modes through a quadratic correction term, given by the action of a quadratic operator on the POD coefficients. Differently from the state-of-the-art methodologies, where the operator is learned via least-squares optimisation, we propose to parametrise the operator by a Multi-Input Operators Network (MIONet). This way, we are able to build models with higher generalisation capabilities, where the operator itself is continuous in space -- thus agnostic of the domain discretisation -- and parameter-dependent. We test our model on two standard benchmarks in fluid dynamics and show that the correction term improves the accuracy of standard POD-based ROMs.

Luca Venturi, Davide Torlo, Francesco Ballarin et al.

In this manuscript we discuss weighted reduced order methods for stochastic partial differential equations. Random inputs (such as forcing terms, equation coefficients, boundary conditions) are considered as parameters of the equations. We take advantage of the resulting parametrized formulation to propose an efficient reduced order model; we also profit by the underlying stochastic assumption in the definition of suitable weights to drive to reduction process. Two viable strategies are discussed, namely the weighted reduced basis method and the weighted proper orthogonal decomposition method. A numerical example on a parametrized elasticity problem is shown.

Federico Tamburlin, Giovanni Canali, Giuseppe Alessio D'Inverno et al.

This work presents a differentiable framework for the parametrization and shape optimization of industrial CAD geometries represented by multi-patch NURBS surfaces. The method enables the deformation of complex CAD models through a physics-informed geometric parametrization, allowing direct morphing driven by physical constraints without the need to prescribe a predefined deformation strategy. A neural displacement field, implemented as a multi-layer perceptron acting on the NURBS control points, provides a compact parametrization of the admissible design space while preserving patch connectivity. Global geometric quantities relevant to hydrostatic design, including displaced volume, wetted surface area and buoyancy centroid, are formulated as differentiable integral operators evaluated on the parametric domain. These quantities are computed through Gauss-Legendre quadrature combined with analytical B-spline derivatives for surface metric evaluation, allowing gradient propagation to the deformation parameters while limiting the computational overhead of automatic differentiation. The proposed framework operates directly on CAD representations without intermediate mesh generation. Numerical experiments on a modified KVLCC2 hull demonstrate the capability of the method to satisfy competing hydrostatic constraints while producing smooth CAD-compatible geometries and showing stable convergence across multiple random initializations.

Moaad Khamlich, Federico Pichi, Michele Girfoglio et al.

We present a novel reduced-order Model (ROM) that leverages optimal transport (OT) theory and displacement interpolation to enhance the representation of nonlinear dynamics in complex systems. While traditional ROM techniques face challenges in this scenario, especially when data (i.e., observational snapshots) is limited, our method addresses these issues by introducing a data augmentation strategy based on OT principles. The proposed framework generates interpolated solutions tracing geodesic paths in the space of probability distributions, enriching the training dataset for the ROM. A key feature of our approach is its ability to provide a continuous representation of the solution's dynamics by exploiting a virtual-to-real time mapping. This enables the reconstruction of solutions at finer temporal scales than those provided by the original data. To further improve prediction accuracy, we employ Gaussian Process Regression to learn the residual and correct the representation between the interpolated snapshots and the physical solution. We demonstrate the effectiveness of our methodology with atmospheric mesoscale benchmarks characterized by highly nonlinear, advection-dominated dynamics. Our results show improved accuracy and efficiency in predicting complex system behaviors, indicating the potential of this approach for a wide range of applications in computational physics and engineering.

Lander Besabe, Michele Girfoglio, Simona Perotto et al.

We develop an Isotropic Recovery-based Error Estimator (IREE) to drive mesh adaptation within a finite volume framework. Recovery-based error estimators are widely used in practice thanks to their simplicity, relying solely on the available discrete solution and a suitable post-processing step. While recovery-based estimators are well established in the finite element framework, their application to finite volume methods, despite the widespread use of the latter in industrial and commercial codes, remains largely unexplored and motivates the present study. We assess the performance of the proposed IREE-driven mesh adaptation procedure through well-known benchmarks for dry atmospheric flows modeling and compare it against a widely-used plain mesh adaptation algorithm. Both qualitative and quantitative results show that the IREE algorithm is more effective at suppressing numerical instabilities compared with the plain approach and, for most of the simulation time, provides a superior accuracy, though at a moderately higher computational cost. In addition, both the adaptive approaches offer substantial computational savings (between 35% and 94%) relative to simulations based on fixed uniformly fine meshes. These findings demonstrate that IREE-based mesh adaptation is a promising and effective strategy for atmospheric flow simulations and has the potential to substantially reduce the computational effort of generating reanalysis-quality data.

Sajad Salavatidezfouli, Saeid Rakhsha, Armin Sheidani et al.

This paper aims to comprehensively investigate the efficacy of various Model Order Reduction (MOR) and deep learning techniques in predicting heat transfer in a pulsed jet impinging on a concave surface. Expanding on the previous experimental and numerical research involving pulsed circular jets, this investigation extends to evaluate Predictive Surrogate Models (PSM) for heat transfer across various jet characteristics. To this end, this work introduces two predictive approaches, one employing a Fast Fourier Transformation augmented Artificial Neural Network (FFT-ANN) for predicting the average Nusselt number under constant-frequency scenarios. Moreover, the investigation introduces the Proper Orthogonal Decomposition and Long Short-Term Memory (POD-LSTM) approach for random-frequency impingement jets. The POD-LSTM method proves to be a robust solution for predicting the local heat transfer rate under random-frequency impingement scenarios, capturing both the trend and value of temporal modes. The comparison of these approaches highlights the versatility and efficacy of advanced machine learning techniques in modelling complex heat transfer phenomena.

Dario Coscia, Max Welling, Nicola Demo et al.

Autoregressive and recurrent networks have achieved remarkable progress across various fields, from weather forecasting to molecular generation and Large Language Models. Despite their strong predictive capabilities, these models lack a rigorous framework for addressing uncertainty, which is key in scientific applications such as PDE solving, molecular generation and Machine Learning Force Fields. To address this shortcoming we present BARNN: a variational Bayesian Autoregressive and Recurrent Neural Network. BARNNs aim to provide a principled way to turn any autoregressive or recurrent model into its Bayesian version. BARNN is based on the variational dropout method, allowing to apply it to large recurrent neural networks as well. We also introduce a temporal version of the "Variational Mixtures of Posteriors" prior (tVAMP-prior) to make Bayesian inference efficient and well-calibrated. Extensive experiments on PDE modelling and molecular generation demonstrate that BARNN not only achieves comparable or superior accuracy compared to existing methods, but also excels in uncertainty quantification and modelling long-range dependencies.

Dario Coscia, Nicola Demo, Gianluigi Rozza

In this work, we present GAROM, a new approach for reduced order modelling (ROM) based on generative adversarial networks (GANs). GANs have the potential to learn data distribution and generate more realistic data. While widely applied in many areas of deep learning, little research is done on their application for ROM, i.e. approximating a high-fidelity model with a simpler one. In this work, we combine the GAN and ROM framework, by introducing a data-driven generative adversarial model able to learn solutions to parametric differential equations. The latter is achieved by modelling the discriminator network as an autoencoder, extracting relevant features of the input, and applying a conditioning mechanism to the generator and discriminator networks specifying the differential equation parameters. We show how to apply our methodology for inference, provide experimental evidence of the model generalisation, and perform a convergence study of the method.

Giulio Ortali, Alessandro Corbetta, Gianluigi Rozza et al.

The development of turbulence closure models, parametrizing the influence of small non-resolved scales on the dynamics of large resolved ones, is an outstanding theoretical challenge with vast applicative relevance. We present a closure, based on deep recurrent neural networks, that quantitatively reproduces, within statistical errors, Eulerian and Lagrangian structure functions and the intermittent statistics of the energy cascade, including those of subgrid fluxes. To achieve high-order statistical accuracy, and thus a stringent statistical test, we employ shell models of turbulence. Our results encourage the development of similar approaches for 3D Navier-Stokes turbulence.

Salvatore Cuomo, Vincenzo Schiano di Cola, Fabio Giampaolo et al.

Physics-Informed Neural Networks (PINN) are neural networks (NNs) that encode model equations, like Partial Differential Equations (PDE), as a component of the neural network itself. PINNs are nowadays used to solve PDEs, fractional equations, integral-differential equations, and stochastic PDEs. This novel methodology has arisen as a multi-task learning framework in which a NN must fit observed data while reducing a PDE residual. This article provides a comprehensive review of the literature on PINNs: while the primary goal of the study was to characterize these networks and their related advantages and disadvantages. The review also attempts to incorporate publications on a broader range of collocation-based physics informed neural networks, which stars form the vanilla PINN, as well as many other variants, such as physics-constrained neural networks (PCNN), variational hp-VPINN, and conservative PINN (CPINN). The study indicates that most research has focused on customizing the PINN through different activation functions, gradient optimization techniques, neural network structures, and loss function structures. Despite the wide range of applications for which PINNs have been used, by demonstrating their ability to be more feasible in some contexts than classical numerical techniques like Finite Element Method (FEM), advancements are still possible, most notably theoretical issues that remain unresolved.

Nicola Demo, Maria Strazzullo, Gianluigi Rozza

In this work we propose an extension of physics informed supervised learning strategies to parametric partial differential equations. Indeed, even if the latter are indisputably useful in many applications, they can be computationally expensive most of all in a real-time and many-query setting. Thus, our main goal is to provide a physics informed learning paradigm to simulate parametrized phenomena in a small amount of time. The physics information will be exploited in many ways, in the loss function (standard physics informed neural networks), as an augmented input (extra feature employment) and as a guideline to build an effective structure for the neural network (physics informed architecture). These three aspects, combined together, will lead to a faster training phase and to a more accurate parametric prediction. The methodology has been tested for several equations and also in an optimal control framework.

Laura Meneghetti, Nicola Demo, Gianluigi Rozza

The focus of this paper is the application of classical model order reduction techniques, such as Active Subspaces and Proper Orthogonal Decomposition, to Deep Neural Networks. We propose a generic methodology to reduce the number of layers of a pre-trained network by combining the aforementioned techniques for dimensionality reduction with input-output mappings, such as Polynomial Chaos Expansion and Feedforward Neural Networks. The necessity of compressing the architecture of an existing Convolutional Neural Network is motivated by its application in embedded systems with specific storage constraints. Our experiment shows that the reduced nets obtained can achieve a level of accuracy similar to the original Convolutional Neural Network under examination, while saving in memory allocation.

Federico Pichi, Francesco Ballarin, Gianluigi Rozza et al.

This work deals with the investigation of bifurcating fluid phenomena using a reduced order modelling setting aided by artificial neural networks. We discuss the POD-NN approach dealing with non-smooth solutions set of nonlinear parametrized PDEs. Thus, we study the Navier-Stokes equations describing: (i) the Coanda effect in a channel, and (ii) the lid driven triangular cavity flow, in a physical/geometrical multi-parametrized setting, considering the effects of the domain's configuration on the position of the bifurcation points. Finally, we propose a reduced manifold-based bifurcation diagram for a non-intrusive recovery of the critical points evolution. Exploiting such detection tool, we are able to efficiently obtain information about the pattern flow behaviour, from symmetry breaking profiles to attaching/spreading vortices, even at high Reynolds numbers.

Davide Papapicco, Nicola Demo, Michele Girfoglio et al.

Models with dominant advection always posed a difficult challenge for projection-based reduced order modelling. Many methodologies that have recently been proposed are based on the pre-processing of the full-order solutions to accelerate the Kolmogorov N-width decay thereby obtaining smaller linear subspaces with improved accuracy. These methods however must rely on the knowledge of the characteristic speeds in phase space of the solution, limiting their range of applicability to problems with explicit functional form for the advection field. In this work we approach the problem of automatically detecting the correct pre-processing transformation in a statistical learning framework by implementing a deep-learning architecture. The purely data-driven method allowed us to generalise the existing approaches of linear subspace manipulation to non-linear hyperbolic problems with unknown advection fields. The proposed algorithm has been validated against simple test cases to benchmark its performances and later successfully applied to a multiphase simulation.

Francesco Romor, Marco Tezzele, Gianluigi Rozza

Parameter space reduction has been proved to be a crucial tool to speed-up the execution of many numerical tasks such as optimization, inverse problems, sensitivity analysis, and surrogate models' design, especially when in presence of high-dimensional parametrized systems. In this work we propose a new method called local active subspaces (LAS), which explores the synergies of active subspaces with supervised clustering techniques in order to carry out a more efficient dimension reduction in the parameter space. The clustering is performed without losing the input-output relations by introducing a distance metric induced by the global active subspace. We present two possible clustering algorithms: K-medoids and a hierarchical top-down approach, which is able to impose a variety of subdivision criteria specifically tailored for parameter space reduction tasks. This method is particularly useful for the community working on surrogate modelling. Frequently, the parameter space presents subdomains where the objective function of interest varies less on average along different directions. So, it could be approximated more accurately if restricted to those subdomains and studied separately. We tested the new method over several numerical experiments of increasing complexity, we show how to deal with vectorial outputs, and how to classify the different regions with respect to the local active subspace dimension. Employing this classification technique as a preprocessing step in the parameter space, or output space in case of vectorial outputs, brings remarkable results for the purpose of surrogate modelling.

Matteo Zancanaro, Markus Mrosek, Giovanni Stabile et al.

Geometrically parametrized Partial Differential Equations are nowadays widely used in many different fields as, for example, shape optimization processes or patient specific surgery studies. The focus of this work is on some advances for this topic, capable of increasing the accuracy with respect to previous approaches while relying on a high cost-benefit ratio performance. The main scope of this paper is the introduction of a new technique mixing up a classical Galerkin-projection approach together with a data-driven method to obtain a versatile and accurate algorithm for the resolution of geometrically parametrized incompressible turbulent Navier-Stokes problems. The effectiveness of this procedure is demonstrated on two different test cases: a classical academic back step problem and a shape deformation Ahmed body application. The results show into details the properties of the architecture we developed while exposing possible future perspectives for this work.

Francesco Romor, Marco Tezzele, Gianluigi Rozza

Gaussian processes are employed for non-parametric regression in a Bayesian setting. They generalize linear regression, embedding the inputs in a latent manifold inside an infinite-dimensional reproducing kernel Hilbert space. We can augment the inputs with the observations of low-fidelity models in order to learn a more expressive latent manifold and thus increment the model's accuracy. This can be realized recursively with a chain of Gaussian processes with incrementally higher fidelity. We would like to extend these multi-fidelity model realizations to case studies affected by a high-dimensional input space but with low intrinsic dimensionality. In this cases physical supported or purely numerical low-order models are still affected by the curse of dimensionality when queried for responses. When the model's gradient information is provided, the presence of an active subspace can be exploited to design low-fidelity response surfaces and thus enable Gaussian process multi-fidelity regression, without the need to perform new simulations. This is particularly useful in the case of data scarcity. In this work we present a multi-fidelity approach involving active subspaces and we test it on two different high-dimensional benchmarks.

Nicola Demo, Marco Tezzele, Andrea Mola et al.

In the reduced order modeling (ROM) framework, the solution of a parametric partial differential equation is approximated by combining the high-fidelity solutions of the problem at hand for several properly chosen configurations. Examples of the ROM application, in the naval field, can be found in [31, 24]. Mandatory ingredient for the ROM methods is the relation between the high-fidelity solutions and the parameters. Dealing with geometrical parameters, especially in the industrial context, this relation may be unknown and not trivial (simulations over hand morphed geometries) or very complex (high number of parameters or many nested morphing techniques). To overcome these scenarios, we propose in this contribution an efficient and complete data-driven framework involving ROM techniques for shape design and optimization, extending the pipeline presented in [7]. By applying the singular value decomposition (SVD) to the points coordinates defining the hull geometry - assuming the topology is inaltered by the deformation -, we are able to compute the optimal space which the deformed geometries belong to, hence using the modal coefficients as the new parameters we can reconstruct the parametric formulation of the domain. Finally the output of interest is approximated using the proper orthogonal decomposition with interpolation technique. To conclude, we apply this framework to a naval shape design problem where the bulbous bow is morphed to reduce the total resistance of the ship advancing in calm water.

Andrea Mola, Marco Tezzele, Mahmoud Gadalla et al.

In this work, we present the results of a ship propeller design optimization campaign carried out in the framework of the research project PRELICA, funded by the Friuli Venezia Giulia regional government. The main idea of this work is to operate on a multidisciplinary level to identify propeller shapes that lead to reduced tip vortex-induced pressure and increased efficiency without altering the thrust. First, a specific tool for the bottom-up construction of parameterized propeller blade geometries has been developed. The algorithm proposed operates with a user defined number of arbitrary shaped or NACA airfoil sections, and employs arbitrary degree NURBS to represent the chord, pitch, skew and rake distribution as a function of the blade radial coordinate. The control points of such curves have been modified to generate, in a fully automated way, a family of blade geometries depending on as many as 20 shape parameters. Such geometries have then been used to carry out potential flow simulations with the Boundary Element Method based software PROCAL. Given the high number of parameters considered, such a preliminary stage allowed for a fast evaluation of the performance of several hundreds of shapes. In addition, the data obtained from the potential flow simulation allowed for the application of a parameter space reduction methodology based on active subspaces (AS) property, which suggested that the main propeller performance indices are, at a first but rather accurate approximation, only depending on a single parameter which is a linear combination of all the original geometric ones. AS analysis has also been used to carry out a constrained optimization exploiting response surface method in the reduced parameter space, and a sensitivity analysis based on such surrogate model. The few selected shapes were finally used to set up high fidelity RANS simulations and select an optimal shape.

Marco Tezzele, Nicola Demo, Gianluigi Rozza

We propose a numerical pipeline for shape optimization in naval engineering involving two different non-intrusive reduced order method (ROM) techniques. Such methods are proper orthogonal decomposition with interpolation (PODI) and dynamic mode decomposition (DMD). The ROM proposed will be enhanced by active subspaces (AS) as a pre-processing tool that reduce the parameter space dimension and suggest better sampling of the input space. We will focus on geometrical parameters describing the perturbation of a reference bulbous bow through the free form deformation (FFD) technique. The ROM are based on a finite volume method (FV) to simulate the multi-phase incompressible flow around the deformed hulls. In previous works we studied the reduction of the parameter space in naval engineering through AS [38, 10] focusing on different parts of the hull. PODI and DMD have been employed for the study of fast and reliable shape optimization cycles on a bulbous bow in [9]. The novelty of this work is the simultaneous reduction of both the input parameter space and the output fields of interest. In particular AS will be trained computing the total drag resistance of a hull advancing in calm water and its gradients with respect to the input parameters. DMD will improve the performance of each simulation of the campaign using only few snapshots of the solution fields in order to predict the regime state of the system. Finally PODI will interpolate the coefficients of the POD decomposition of the output fields for a fast approximation of all the fields at new untried parameters given by the optimization algorithm. This will result in a non-intrusive data-driven numerical optimization pipeline completely independent with respect to the full order solver used and it can be easily incorporated into existing numerical pipelines, from the reference CAD to the optimal shape.

Martin W. Hess, Annalisa Quaini, Gianluigi Rozza

We consider the Navier-Stokes equations in a channel with a narrowing of varying height. The model is discretized with high-order spectral element ansatz functions, resulting in 6372 degrees of freedom. The steady-state snapshot solutions define a reduced order space through a standard POD procedure. The reduced order space allows to accurately and efficiently evaluate the steady-state solutions for different geometries. In particular, we detail different aspects of implementing the reduced order model in combination with a spectral element discretization. It is shown that an expansion in element-wise local degrees of freedom can be combined with a reduced order modelling approach to enhance computational times in parametric many-query scenarios.

Saray Busto, Giovanni Stabile, Gianluigi Rozza et al.

The purpose of this work is to introduce a novel POD-Galerkin strategy for the hybrid finite volume/finite element solver introduced in Bermúdez et al. 2014 and Busto et al. 2018. The interest is into the incompressible Navier-Stokes equations coupled with an additional transport equation. The full order model employed in this article makes use of staggered meshes. This feature will be conveyed to the reduced order model leading to the definition of reduced basis spaces in both meshes. The reduced order model presented herein accounts for velocity, pressure, and a transport-related variable. The pressure term at both the full order and the reduced order level is reconstructed making use of a projection method. More precisely, a Poisson equation for pressure is considered within the reduced order model. Results are verified against three-dimensional manufactured test cases. Moreover a modified version of the classical cavity test benchmark including the transport of a species is analysed.

Marco Tezzele, Nicola Demo, Mahmoud Gadalla et al.

We present the results of the application of a parameter space reduction methodology based on active subspaces (AS) to the hull hydrodynamic design problem. Several parametric deformations of an initial hull shape are considered to assess the influence of the shape parameters on the hull wave resistance. Such problem is relevant at the preliminary stages of the ship design, when several flow simulations are carried out by the engineers to establish a certain sensibility with respect to the parameters, which might result in a high number of time consuming hydrodynamic simulations. The main idea of this work is to employ the AS to identify possible lower dimensional structures in the parameter space. The complete pipeline involves the use of free form deformation to parametrize and deform the hull shape, the high fidelity solver based on unsteady potential flow theory with fully nonlinear free surface treatment directly interfaced with CAD, the use of dynamic mode decomposition to reconstruct the final steady state given only few snapshots of the simulation, and the reduction of the parameter space by AS, and shared subspace. Response surface method is used to minimize the total drag.

Tomás Chacón Rebollo, Enrique Delgado Ávila, Macarena Gómez Mármol et al.

In this work we present a reduced basis Smagorinsky turbulence model for steady flows. We approximate the non-linear eddy diffusion term using the Empirical Interpolation Method, and the velocity-pressure unknowns by an independent reduced-basis procedure. This model is based upon an a posteriori error estimation for Smagorinsky turbulence model. The theoretical development of the a posteriori error estimation is based on previous works, according to the Brezzi-Rappaz-Raviart stability theory, and adapted for the non-linear eddy diffusion term. We present some numerical tests, programmed in FreeFem++, in which we show an speedup on the computation by factor larger than 1000 in benchmark 2D flows.