NAOct 7, 2010
Exponential Runge-Kutta methods for stiff kinetic equationsGiacomo Dimarco, Lorenzo Pareschi
We introduce a class of exponential Runge-Kutta integration methods for kinetic equations. The methods are based on a decomposition of the collision operator into an equilibrium and a non equilibrium part and are exact for relaxation operators of BGK type. For Boltzmann type kinetic equations they work uniformly for a wide range of relaxation times and avoid the solution of nonlinear systems of equations even in stiff regimes. We give sufficient conditions in order that such methods are unconditionally asymptotically stable and asymptotic preserving. Such stability properties are essential to guarantee the correct asymptotic behavior for small relaxation times. The methods also offer favorable properties such as nonnegativity of the solution and entropy inequality. For this reason, as we will show, the methods are suitable both for deterministic as well as probabilistic numerical techniques.
NANov 9, 2017
Structure preserving schemes for nonlinear Fokker-Planck equations and applicationsLorenzo Pareschi, Mattia Zanella
In this paper we focus on the construction of numerical schemes for nonlinear Fokker-Planck equations that preserve the structural properties, like non negativity of the solution, entropy dissipation and large time behavior. The methods here developed are second order accurate, they do not require any restriction on the mesh size and are capable to capture the asymptotic steady states with arbitrary accuracy. These properties are essential for a correct description of the underlying physical problem. Applications of the schemes to several nonlinear Fokker-Planck equations with nonlocal terms describing emerging collective behavior in socio-economic and life sciences are presented.
COMP-PHMar 4, 2012
Binary interaction algorithms for the simulation of flocking and swarming dynamicsGiacomo Albi, Lorenzo Pareschi
Microscopic models of flocking and swarming takes in account large numbers of interacting individ- uals. Numerical resolution of large flocks implies huge computational costs. Typically for $N$ interacting individuals we have a cost of $O(N^2)$. We tackle the problem numerically by considering approximated binary interaction dynamics described by kinetic equations and simulating such equations by suitable stochastic methods. This approach permits to compute approximate solutions as functions of a small scaling parameter $\varepsilon$ at a reduced complexity of O(N) operations. Several numerical results show the efficiency of the algorithms proposed.
NAApr 1, 2016
Opinion dynamics over complex networks: kinetic modeling and numerical methodsGiacomo Albi, Lorenzo Pareschi, Mattia Zanella
In this paper we consider the modeling of opinion dynamics over time dependent large scale networks. A kinetic description of the agents' distribution over the evolving network is considered which combines an opinion update based on binary interactions between agents with a dynamic creation and removal process of new connections. The number of connections of each agent influences the spreading of opinions in the network but also the way connections are created is influenced by the agents' opinion. The evolution of the network of connections is studied by showing that its asymptotic behavior is consistent both with Poisson distributions and truncated power-laws. In order to study the large time behavior of the opinion dynamics a mean field description is derived which allows to compute exact stationary solutions in some simplified situations. Numerical methods which are capable to describe correctly the large time behavior of the system are also introduced and discussed. Finally, several numerical examples showing the influence of the agents' number of connections in the opinion dynamics are reported.
NASep 28, 2010
Spectral methods for the non cut-off Boltzmann equation and numerical grazing collision limitLorenzo Pareschi, Giuseppe Toscani, Cédric Villani
In this paper we study the numerical passage from the spatially homogeneous Boltzmann equation without cut-off to the Fokker-Planck-Landau equation in the so-called grazing collision limit. To this aim we derive a Fourier spectral method for the non cut-off Boltzmann equation in the spirit of L. Pareschi, B.Perthame, TTSP 25, (1996) and L.Pareschi, G.Russo, SINUM 37, (2000). We show that the kernel modes that define the spectral method have the correct grazing collision limit providing a consistent spectral method for the limiting Fokker-Planck-Landau equation. In particular, for small values of the scattering angle, we derive an approximate formula for the kernel modes of the non cut-off Boltzmann equation which, similarly to the Fokker-Planck-Landau case, can be computed with a fast algorithm. The uniform spectral accuracy of the method with respect to the grazing collision parameter is also proved.
NAMar 2, 2015
Uncertainty Quantification in Control Problems for Flocking ModelsGiacomo Albi, Lorenzo Pareschi, Mattia Zanella
In this paper the optimal control of flocking models with random inputs is investigated from a numerical point of view. The effect of uncertainty in the interaction parameters is studied for a Cucker-Smale type model using a generalized polynomial chaos (gPC) approach. Numerical evidence of threshold effects in the alignment dynamic due to the random parameters is given. The use of a selective model predictive control permits to steer the system towards the desired state even in unstable regimes.
NAMar 1, 2016
Implicit-explicit linear multistep methods for stiff kinetic equationsGiacomo Dimarco, Lorenzo Pareschi
We consider the development of high order asymptotic-preserving linear multistep methods for kinetic equations and related problems. The methods are first developed for BGK-like kinetic models and then extended to the case of the full Boltzmann equation. The behavior of the schemes in the Navier-Stokes regime is also studied and compatibility conditions derived. We show that, compared to IMEX Runge-Kutta methods, the IMEX multistep schemes have several advantages due to the absence of coupling conditions and to the greater computational efficiency. The latter is of paramount importance when dealing with the time discretization of multidimensional kinetic equations.
NAMar 11, 2019
Multi-scale control variate methods for uncertainty quantification in kinetic equationsGiacomo Dimarco, Lorenzo Pareschi
Kinetic equations play a major rule in modeling large systems of interacting particles. Uncertainties may be due to various reasons, like lack of knowledge on the microscopic interaction details or incomplete informations at the boundaries. These uncertainties, however, contribute to the curse of dimensionality and the development of efficient numerical methods is a challenge. In this paper we consider the construction of novel multi-scale methods for such problems which, thanks to a control variate approach, are capable to reduce the variance of standard Monte Carlo techniques.
SOC-PHJun 16, 2016
Kinetic models of collective decision-making in the presence of equality biasLorenzo Pareschi, Pierluigi Vellucci, Mattia Zanella
We introduce and discuss kinetic models describing the influence of the competence in the evolution of decisions in a multi-agent system. The original exchange mechanism, which is based on the human tendency to compromise and change opinion through self-thinking, is here modified to include the role of the agents' competence. In particular, we take into account the agents' tendency to behave in the same way as if they were as good, or as bad, as their partner: the so-called equality bias. This occurred in a situation where a wide gap separated the competence of group members. We discuss the main properties of the kinetic models and numerically investigate some examples of collective decision under the influence of the equality bias. The results confirm that the equality bias leads the group to suboptimal decisions.
NAFeb 23, 2012
High order asymptotic-preserving schemes for the Boltzmann equationGiacomo Dimarco, Lorenzo Pareschi
In this note we discuss the construction of high order asymptotic preserving numerical schemes for the Boltzmann equation. The methods are based on the use of Implicit-Explicit (IMEX) Runge-Kutta methods combined with a penalization technique recently introduced in [F. Filbet, S. Jin: A class of asymptotic preserving schemes for kinetic equations and related problems with stiff sources,J. Comp. Phys. 229, (2010), pp. 7625-7648.].
NAFeb 6, 2012
Implicit-Explicit Runge-Kutta schemes for numerical discretization of optimal control problemsMichael Herty, Lorenzo Pareschi, Sonja Steffensen
Implicit-explicit (IMEX) Runge-Kutta methods play a major rule in the numerical treatment of differential systems governed by stiff and non-stiff terms. This paper discusses order conditions and symplecticity properties of a class of IMEX Runge-Kutta methods in the context of optimal control problems. The analysis of the schemes is based on the continuous optimality system. Using suitable transformations of the adjoint equation, order conditions up to order three are proven as well as the relation between adjoint schemes obtained through different transformations is investigated. Conditions for the IMEX Runge-Kutta methods to be symplectic are also derived. A numerical example illustrating the theoretical properties is presented.
NADec 14, 2012
Convolutive decomposition and fast summation methods for discrete-velocity approximations of the Boltzmann equationClément Mouhot, Lorenzo Pareschi, Thomas Rey
Discrete-velocity approximations represent a popular way for computing the Boltzmann collision operator. The direct numerical evaluation of such methods involve a prohibitive cost, typically $O(N^{2d+1})$ where $d$ is the dimension of the velocity space. In this paper, following the ideas introduced in [27,28], we derive fast summation techniques for the evaluation of discrete-velocity schemes which permits to reduce the computational cost from $O(N^{2d+1})$ to $O(\bar{N}^d N^d\log_2 N)$, $\bar{N} << N$, with almost no loss of accuracy.
NAAug 8, 2014
On steady-state preserving spectral methods for homogeneous Boltzmann equationsFrancis Filbet, Lorenzo Pareschi, Thomas Rey
In this note, we present a general way to construct spectral methods for the collision operator of the Boltzmann equation which preserves exactly the Maxwellian steady-state of the system. We show that the resulting method is able to approximate with spectral accuracy the solution uniformly in time.
COMP-PHOct 4, 2010
Direct simulation Monte Carlo schemes for Coulomb interactions in plasmasGiacomo Dimarco, Russell Caflisch, Lorenzo Pareschi
We consider the development of Monte Carlo schemes for molecules with Coulomb interactions. We generalize the classic algorithms of Bird and Nanbu-Babovsky for rarefied gas dynamics to the Coulomb case thanks to the approximation introduced by Bobylev and Nanbu (Theory of collision algorithms for gases and plasmas based on the Boltzmann equation and the Landau-Fokker-Planck equation, Physical Review E, Vol. 61, 2000). Thus, instead of considering the original Boltzmann collision operator, the schemes are constructed through the use of an approximated Boltzmann operator. With the above choice larger time steps are possible in simulations; moreover the expensive acceptance-rejection procedure for collisions is avoided and every particle collides. Error analysis and comparisons with the original Bobylev-Nanbu (BN) scheme are performed. The numerical results show agreement with the theoretical convergence rate of the approximated Boltzmann operator and the better performance of Bird-type schemes with respect to the original scheme.
NAJun 25, 2022
Asymptotic-Preserving Neural Networks for multiscale hyperbolic models of epidemic spreadGiulia Bertaglia, Chuan Lu, Lorenzo Pareschi et al.
When investigating epidemic dynamics through differential models, the parameters needed to understand the phenomenon and to simulate forecast scenarios require a delicate calibration phase, often made even more challenging by the scarcity and uncertainty of the observed data reported by official sources. In this context, Physics-Informed Neural Networks (PINNs), by embedding the knowledge of the differential model that governs the physical phenomenon in the learning process, can effectively address the inverse and forward problem of data-driven learning and solving the corresponding epidemic problem. In many circumstances, however, the spatial propagation of an infectious disease is characterized by movements of individuals at different scales governed by multiscale PDEs. This reflects the heterogeneity of a region or territory in relation to the dynamics within cities and in neighboring zones. In presence of multiple scales, a direct application of PINNs generally leads to poor results due to the multiscale nature of the differential model in the loss function of the neural network. To allow the neural network to operate uniformly with respect to the small scales, it is desirable that the neural network satisfies an Asymptotic-Preservation (AP) property in the learning process. To this end, we consider a new class of AP Neural Networks (APNNs) for multiscale hyperbolic transport models of epidemic spread that, thanks to an appropriate AP formulation of the loss function, is capable to work uniformly at the different scales of the system. A series of numerical tests for different epidemic scenarios confirms the validity of the proposed approach, highlighting the importance of the AP property in the neural network when dealing with multiscale problems especially in presence of sparse and partially observed systems.
NADec 12, 2018
Multi-scale variance reduction methods based on multiple control variates for kinetic equations with uncertaintiesGiacomo Dimarco, Lorenzo Pareschi
The development of efficient numerical methods for kinetic equations with stochastic parameters is a challenge due to the high dimensionality of the problem. Recently we introduced a multiscale control variate strategy which is capable to accelerate considerably the slow convergence of standard Monte Carlo methods for uncertainty quantification. Here we generalize this class of methods to the case of multiple control variates. We show that the additional degrees of freedom can be used to improve further the variance reduction properties of multiscale control variate methods.
OCOct 5, 2016
Selective model-predictive control for flocking systemsGiacomo Albi, Lorenzo Pareschi
In this paper the optimal control of alignment models composed by a large number of agents is investigated in presence of a selective action of a controller, acting in order to enhance consensus. Two types of selective controls have been presented: an homogeneous control filtered by a selective function and a distributed control active only on a selective set. As a first step toward a reduction of computational cost, we introduce a model predictive control (MPC) approximation by deriving a numerical scheme with a feedback selective constrained dynamics. Next, in order to cope with the numerical solution of a large number of interacting agents, we derive the mean-field limit of the feedback selective constrained dynamics, which eventually will be solved numerically by means of a stochastic algorithm, able to simulate efficiently the selective constrained dynamics. Finally, several numerical simulations are reported to show the efficiency of the proposed techniques.
NAJul 23, 2018
Linear multistep methods for optimal control problems and applications to hyperbolic relaxation systemsGiacomo Albi, Michael Herty, Lorenzo Pareschi
We are interested in high-order linear multistep schemes for time discretization of adjoint equations arising within optimal control problems. First we consider optimal control problems for ordinary differential equations and show loss of accuracy for Adams-Moulton and Adams-Bashford methods, whereas BDF methods preserve high--order accuracy. Subsequently we extend these results to semi--lagrangian discretizations of hyperbolic relaxation systems. Computational results illustrate theoretical findings.
APFeb 8, 2016
Residual equilibrium schemes for time dependent partial differential equationsLorenzo Pareschi, Thomas Rey
Many applications involve partial differential equations which admits nontrivial steady state solutions. The design of schemes which are able to describe correctly these equilibrium states may be challenging for numerical methods, in particular for high order ones. In this paper, inspired by micro-macro decomposition methods for kinetic equations, we present a class of schemes which are capable to preserve the steady state solution and achieve high order accuracy for a class of time dependent partial differential equations including nonlinear diffusion equations and kinetic equations. Extension to systems of conservation laws with source terms are also discussed.
NAMar 10, 2017
Efficient Stochastic Asymptotic-Preserving IMEX Methods for Transport Equations with Diffusive Scalings and Random InputsShi Jin, Hanqing Lu, Lorenzo Pareschi
For linear transport and radiative heat transfer equations with random inputs, we develop new generalized polynomial chaos based Asymptotic-Preserving stochastic Galerkin schemes that allow efficient computation for the problems that contain both uncertainties and multiple scales. Compared with previous methods for these problems, our new method use the implicit-explicit (IMEX) time discretization to gain higher order accuracy, and by using a modified diffusion operator based penalty method, a more relaxed stability condition--a hyperbolic, rather than parabolic, CFL stability condition, is achieved in the case of small mean free path in the diffusive regime. The stochastic Asymptotic-Preserving property of these methods will be shown asymptotically, and demonstrated numerically, along with computational cost comparison with previous methods.
NAAug 13, 2012
Exponential Runge-Kutta schemes for inhomogeneous Boltzmann equations with high order of accuracyQin Li, Lorenzo Pareschi
We consider the development of exponential methods for the robust time discretization of space inhomogeneous Boltzmann equations in stiff regimes. Compared to the space homogeneous case, or more in general to the case of splitting based methods, studied in Dimarco Pareschi (SIAM J. Num. Anal. 2011) a major difficulty is that the local Maxwellian equilibrium state is not constant in a time step and thus needs a proper numerical treatment. We show how to derive asymptotic preserving (AP) schemes of arbitrary order and in particular using the Shu-Osher representation of Runge-Kutta methods we explore the monotonicity properties of such schemes, like strong stability preserving (SSP) and positivity preserving. Several numerical results confirm our analysis.
NAMay 17, 2017
Structure preserving schemes for mean-field equations of collective behaviorLorenzo Pareschi, Mattia Zanella
In this paper we consider the development of numerical schemes for mean-field equations describing the collective behavior of a large group of interacting agents. The schemes are based on a generalization of the classical Chang-Cooper approach and are capable to preserve the main structural properties of the systems, namely nonnegativity of the solution, physical conservation laws, entropy dissipation and stationary solutions. In particular, the methods here derived are second order accurate in transient regimes whereas they can reach arbitrary accuracy asymptotically for large times. Several examples are reported to show the generality of the approach.
NAOct 16, 2017
A High Order Stochastic Asymptotic Preserving Scheme for Chemotaxis Kinetic Models with Random InputsShi Jin, Hanqing Lu, Lorenzo Pareschi
In this paper, we develop a stochastic Asymptotic-Preserving (sAP) scheme for the kinetic chemotaxis system with random inputs, which will converge to the modified Keller-Segel model with random inputs in the diffusive regime. Based on the generalized Polynomial Chaos (gPC) approach, we design a high order stochastic Galerkin method using implicit-explicit (IMEX) Runge-Kutta (RK) time discretization with a macroscopic penalty term. The new schemes improve the parabolic CFL condition to a hyperbolic type when the mean free path is small, which shows significant efficiency especially in uncertainty quantification (UQ) with multi-scale problems. The stochastic Asymptotic-Preserving property will be shown asymptotically and verified numerically in several tests. Many other numerical tests are conducted to explore the effect of the randomness in the kinetic system, in the aim of providing more intuitions for the theoretic study of the chemotaxis models.
LGDec 30, 2025
Micro-Macro Tensor Neural Surrogates for Uncertainty Quantification in Collisional PlasmaWei Chen, Giacomo Dimarco, Lorenzo Pareschi
Plasma kinetic equations exhibit pronounced sensitivity to microscopic perturbations in model parameters and data, making reliable and efficient uncertainty quantification (UQ) essential for predictive simulations. However, the cost of uncertainty sampling, the high-dimensional phase space, and multiscale stiffness pose severe challenges to both computational efficiency and error control in traditional numerical methods. These aspects are further emphasized in presence of collisions where the high-dimensional nonlocal collision integrations and conservation properties pose severe constraints. To overcome this, we present a variance-reduced Monte Carlo framework for UQ in the Vlasov--Poisson--Landau (VPL) system, in which neural network surrogates replace the multiple costly evaluations of the Landau collision term. The method couples a high-fidelity, asymptotic-preserving VPL solver with inexpensive, strongly correlated surrogates based on the Vlasov--Poisson--Fokker--Planck (VPFP) and Euler--Poisson (EP) equations. For the surrogate models, we introduce a generalization of the separable physics-informed neural network (SPINN), developing a class of tensor neural networks based on an anisotropic micro-macro decomposition, to reduce velocity-moment costs, model complexity, and the curse of dimensionality. To further increase correlation with VPL, we calibrate the VPFP model and design an asymptotic-preserving SPINN whose small- and large-Knudsen limits recover the EP and VP systems, respectively. Numerical experiments show substantial variance reduction over standard Monte Carlo, accurate statistics with far fewer high-fidelity samples, and lower wall-clock time, while maintaining robustness to stochastic dimension.
93.4NAApr 7
Multi-Order Monte Carlo IMEX hierarchies for uncertainty quantification in multiscale hyperbolic systemsGiulia Bertaglia, Walter Boscheri, Lorenzo Pareschi
We introduce a novel Multi-Order Monte Carlo approach for uncertainty quantification in the context of multiscale time-dependent partial differential equations. The new framework leverages Implicit-Explicit Runge-Kutta time integrators to satisfy the asymptotic-preserving property across different discretization orders of accuracy. In contrast to traditional Multi-Level Monte Carlo methods, which require costly hierarchical re-meshing, our method constructs a multi-order hierarchy by varying both spatial and temporal discretization orders within the Monte Carlo framework. This enables efficient variance reduction while naturally adapting to the multiple scales inherent in the problem ensuring asymptotic consistency. The proposed method is particularly well-suited for hyperbolic systems with stiff relaxation, kinetic equations, and low Mach number flows, where standard Multi-Level Monte Carlo techniques often encounter computational challenges. Numerical experiments demonstrate that the novel Multi-Order Monte Carlo approach achieves substantial reduction of both error and variance while maintaining asymptotic consistency in the asymptotic limit.
OCOct 21, 2025
Swarm-based optimization with jumps: a kinetic BGK framework and convergence analysisGiacomo Borghi, Hyesung Im, Lorenzo Pareschi
Metaheuristic algorithms are powerful tools for global optimization, particularly for non-convex and non-differentiable problems where exact methods are often impractical. Particle-based optimization methods, inspired by swarm intelligence principles, have shown effectiveness due to their ability to balance exploration and exploitation within the search space. In this work, we introduce a novel particle-based optimization algorithm where velocities are updated via random jumps, a strategy commonly used to enhance stochastic exploration. We formalize this approach by describing the dynamics through a kinetic modelling of BGK type, offering a unified framework that accommodates general noise distributions, including heavy-tailed ones like Cauchy. Under suitable parameter scaling, the model reduces to the Consensus-Based Optimization (CBO) dynamics. For non-degenerate Gaussian noise in bounded domains, we prove propagation of chaos and convergence towards minimizers. Numerical results on benchmark problems validate the approach and highlight its connection to CBO.
31.3LGMar 20
Two-Time-Scale Learning Dynamics: A Population View of Neural Network TrainingGiacomo Borghi, Hyesung Im, Lorenzo Pareschi
Population-based learning paradigms, including evolutionary strategies, Population-Based Training (PBT), and recent model-merging methods, combine fast within-model optimisation with slower population-level adaptation. Despite their empirical success, a general mathematical description of the resulting collective training dynamics remains incomplete. We introduce a theoretical framework for neural network training based on two-time-scale population dynamics. We model a population of neural networks as an interacting agent system in which network parameters evolve through fast noisy gradient updates of SGD/Langevin type, while hyperparameters evolve through slower selection--mutation dynamics. We prove the large-population limit for the joint distribution of parameters and hyperparameters and, under strong time-scale separation, derive a selection--mutation equation for the hyperparameter density. For each fixed hyperparameter, the fast parameter dynamics relaxes to a Boltzmann--Gibbs measure, inducing an effective fitness for the slow evolution. The averaged dynamics connects population-based learning with bilevel optimisation and classical replicator--mutator models, yields conditions under which the population mean moves toward the fittest hyperparameter, and clarifies the role of noise and diversity in balancing optimisation and exploration. Numerical experiments illustrate both the large-population regime and the reduced two-time-scale dynamics, and indicate that access to the effective fitness, either in closed form or through population-level estimation, can improve population-level updates.
NAFeb 28, 2025
A data augmentation strategy for deep neural networks with application to epidemic modellingMuhammad Awais, Abu Safyan Ali, Giacomo Dimarco et al.
In this work, we integrate the predictive capabilities of compartmental disease dynamics models with machine learning ability to analyze complex, high-dimensional data and uncover patterns that conventional models may overlook. Specifically, we present a proof of concept demonstrating the application of data-driven methods and deep neural networks to a recently introduced Susceptible-Infected-Recovered type model with social features, including a saturated incidence rate, to improve epidemic prediction and forecasting. Our results show that a robust data augmentation strategy trough suitable data-driven models can improve the reliability of Feed-Forward Neural Networks and Nonlinear Autoregressive Networks, providing a complementary strategy to Physics-Informed Neural Networks, particularly in settings where data augmentation from mechanistic models can enhance learning. This approach enhances the ability to handle nonlinear dynamics and offers scalable, data-driven solutions for epidemic forecasting, prioritizing predictive accuracy over the constraints of physics-based models. Numerical simulations of the lockdown and post-lockdown phase of the COVID-19 epidemic in Italy and Spain validate our methodology.
NAJun 12, 2025
Structure and asymptotic preserving deep neural surrogates for uncertainty quantification in multiscale kinetic equationsWei Chen, Giacomo Dimarco, Lorenzo Pareschi
The high dimensionality of kinetic equations with stochastic parameters poses major computational challenges for uncertainty quantification (UQ). Traditional Monte Carlo (MC) sampling methods, while widely used, suffer from slow convergence and high variance, which become increasingly severe as the dimensionality of the parameter space grows. To accelerate MC sampling, we adopt a multiscale control variates strategy that leverages low-fidelity solutions from simplified kinetic models to reduce variance. To further improve sampling efficiency and preserve the underlying physics, we introduce surrogate models based on structure and asymptotic preserving neural networks (SAPNNs). These deep neural networks are specifically designed to satisfy key physical properties, including positivity, conservation laws, entropy dissipation, and asymptotic limits. By training the SAPNNs on low-fidelity models and enriching them with selected high-fidelity samples from the full Boltzmann equation, our method achieves significant variance reduction while maintaining physical consistency and asymptotic accuracy. The proposed methodology enables efficient large-scale prediction in kinetic UQ and is validated across both homogeneous and nonhomogeneous multiscale regimes. Numerical results demonstrate improved accuracy and computational efficiency compared to standard MC techniques.
NAOct 10, 2025
Augmented data and neural networks for robust epidemic forecasting: application to COVID-19 in ItalyGiacomo Dimarco, Federica Ferrarese, Lorenzo Pareschi
In this work, we propose a data augmentation strategy aimed at improving the training phase of neural networks and, consequently, the accuracy of their predictions. Our approach relies on generating synthetic data through a suitable compartmental model combined with the incorporation of uncertainty. The available data are then used to calibrate the model, which is further integrated with deep learning techniques to produce additional synthetic data for training. The results show that neural networks trained on these augmented datasets exhibit significantly improved predictive performance. We focus in particular on two different neural network architectures: Physics-Informed Neural Networks (PINNs) and Nonlinear Autoregressive (NAR) models. The NAR approach proves especially effective for short-term forecasting, providing accurate quantitative estimates by directly learning the dynamics from data and avoiding the additional computational cost of embedding physical constraints into the training. In contrast, PINNs yield less accurate quantitative predictions but capture the qualitative long-term behavior of the system, making them more suitable for exploring broader dynamical trends. Numerical simulations of the second phase of the COVID-19 pandemic in the Lombardy region (Italy) validate the effectiveness of the proposed approach.
NADec 10, 2020
From particle swarm optimization to consensus based optimization: stochastic modeling and mean-field limitSara Grassi, Lorenzo Pareschi
In this paper we consider a continuous description based on stochastic differential equations of the popular particle swarm optimization (PSO) process for solving global optimization problems and derive in the large particle limit the corresponding mean-field approximation based on Vlasov-Fokker-Planck-type equations. The disadvantage of memory effects induced by the need to store the local best position is overcome by the introduction of an additional differential equation describing the evolution of the local best. A regularization process for the global best permits to formally derive the respective mean-field description. Subsequently, in the small inertia limit, we compute the related macroscopic hydrodynamic equations that clarify the link with the recently introduced consensus based optimization (CBO) methods. Several numerical examples illustrate the mean field process, the small inertia limit and the potential of this general class of global optimization methods.
APJan 31, 2020
Consensus-Based Optimization on Hypersurfaces: Well-Posedness and Mean-Field LimitMassimo Fornasier, Hui Huang, Lorenzo Pareschi et al.
We introduce a new stochastic differential model for global optimization of nonconvex functions on compact hypersurfaces. The model is inspired by the stochastic Kuramoto-Vicsek system and belongs to the class of Consensus-Based Optimization methods. In fact, particles move on the hypersurface driven by a drift towards an instantaneous consensus point, computed as a convex combination of the particle locations weighted by the cost function according to Laplace's principle. The consensus point represents an approximation to a global minimizer. The dynamics is further perturbed by a random vector field to favor exploration, whose variance is a function of the distance of the particles to the consensus point. In particular, as soon as the consensus is reached, then the stochastic component vanishes. In this paper, we study the well-posedness of the model and we derive rigorously its mean-field approximation for large particle limit.
LGJan 31, 2020
Consensus-Based Optimization on the Sphere: Convergence to Global Minimizers and Machine LearningMassimo Fornasier, Hui Huang, Lorenzo Pareschi et al.
We investigate the implementation of a new stochastic Kuramoto-Vicsek-type model for global optimization of nonconvex functions on the sphere. This model belongs to the class of Consensus-Based Optimization. In fact, particles move on the sphere driven by a drift towards an instantaneous consensus point, which is computed as a convex combination of particle locations, weighted by the cost function according to Laplace's principle, and it represents an approximation to a global minimizer. The dynamics is further perturbed by a random vector field to favor exploration, whose variance is a function of the distance of the particles to the consensus point. In particular, as soon as the consensus is reached the stochastic component vanishes. The main results of this paper are about the proof of convergence of the numerical scheme to global minimizers provided conditions of well-preparation of the initial datum. The proof combines previous results of mean-field limit with a novel asymptotic analysis, and classical convergence results of numerical methods for SDE. We present several numerical experiments, which show that the algorithm proposed in the present paper scales well with the dimension and is extremely versatile. To quantify the performances of the new approach, we show that the algorithm is able to perform essentially as good as ad hoc state of the art methods in challenging problems in signal processing and machine learning, namely the phase retrieval problem and the robust subspace detection.
NAOct 2, 2018
Structure preserving schemes for the continuum Kuramoto model: phase transitionsJosé A. Carrillo, Young-Pil Choi, Lorenzo Pareschi
The construction of numerical schemes for the Kuramoto model is challenging due to the structural properties of the system which are essential in order to capture the correct physical behavior, like the description of stationary states and phase transitions. Additional difficulties are represented by the high dimensionality of the problem in presence of multiple frequencies. In this paper, we develop numerical methods which are capable to preserve these structural properties of the Kuramoto equation in the presence of diffusion and to solve efficiently the multiple frequencies case. The novel schemes are then used to numerically investigate the phase transitions in the case of identical and non identical oscillators.
NAJun 22, 2017
Uncertainty quantification for kinetic models in socio-economic and life sciencesGiacomo Dimarco, Lorenzo Pareschi, Mattia Zanella
Kinetic equations play a major rule in modeling large systems of interacting particles. Recently the legacy of classical kinetic theory found novel applications in socio-economic and life sciences, where processes characterized by large groups of agents exhibit spontaneous emergence of social structures. Well-known examples are the formation of clusters in opinion dynamics, the appearance of inequalities in wealth distributions, flocking and milling behaviors in swarming models, synchronization phenomena in biological systems and lane formation in pedestrian traffic. The construction of kinetic models describing the above processes, however, has to face the difficulty of the lack of fundamental principles since physical forces are replaced by empirical social forces. These empirical forces are typically constructed with the aim to reproduce qualitatively the observed system behaviors, like the emergence of social structures, and are at best known in terms of statistical information of the modeling parameters. For this reason the presence of random inputs characterizing the parameters uncertainty should be considered as an essential feature in the modeling process. In this survey we introduce several examples of such kinetic models, that are mathematically described by nonlinear Vlasov and Fokker--Planck equations, and present different numerical approaches for uncertainty quantification which preserve the main features of the kinetic solution.
NAAug 4, 2009
Fluid Solver Independent Hybrid Methods for Multiscale Kinetic equationsGiacomo Dimarco, Lorenzo Pareschi
In some recent works [G. Dimarco, L. Pareschi, Hybrid multiscale methods I. Hyperbolic Relaxation Problems, Comm. Math. Sci., 1, (2006), pp. 155-177], [G. Dimarco, L. Pareschi, Hybrid multiscale methods II. Kinetic equations, SIAM Multiscale Modeling and Simulation Vol 6., No 4,pp. 1169-1197, (2008)] we developed a general framework for the construction of hybrid algorithms which are able to face efficiently the multiscale nature of some hyperbolic and kinetic problems. Here, at variance with respect to the previous methods, we construct a method form-fitting to any type of finite volume or finite difference scheme for the reduced equilibrium system. Thanks to the coupling of Monte Carlo techniques for the solution of the kinetic equations with macroscopic methods for the limiting fluid equations, we show how it is possible to solve multiscale fluid dynamic phenomena faster with respect to traditional deterministic/stochastic methods for the full kinetic equations. In addition, due to the hybrid nature of the schemes, the numerical solution is affected by less fluctuations when compared to standard Monte Carlo schemes. Applications to the Boltzmann-BGK equation are presented to show the performance of the new methods in comparison with classical approaches used in the simulation of kinetic equations.
MATH-PHAug 3, 2009
The Moment Guided Monte Carlo MethodPierre Degond, Giacomo Dimarco, Lorenzo Pareschi
In this work we propose a new approach for the numerical simulation of kinetic equations through Monte Carlo schemes. We introduce a new technique which permits to reduce the variance of particle methods through a matching with a set of suitable macroscopic moment equations. In order to guarantee that the moment equations provide the correct solutions, they are coupled to the kinetic equation through a non equilibrium term. The basic idea, on which the method relies, consists in guiding the particle positions and velocities through moment equations so that the concurrent solution of the moment and kinetic models furnishes the same macroscopic quantities.
APJul 22, 2006
Solving the Boltzmann equation in N log NFrancis Filbet, Clément Mouhot, Lorenzo Pareschi
In [C. Mouhot and L. Pareschi, "Fast algorithms for computing the Boltzmann collision operator," Math. Comp., to appear; C. Mouhot and L. Pareschi, C. R. Math. Acad. Sci. Paris, 339 (2004), pp. 71-76], fast deterministic algorithms based on spectral methods were derived for the Boltzmann collision operator for a class of interactions including the hard spheres model in dimension three. These algorithms are implemented for the solution of the Boltzmann equation in two and three dimension, first for homogeneous solutions, then for general non homogeneous solutions. The results are compared to explicit solutions, when available, and to Monte-Carlo methods. In particular, the computational cost and accuracy are compared to those of Monte-Carlo methods as well as to those of previous spectral methods. Finally, for inhomogeneous solutions, we take advantage of the great computational efficiency of the method to show an oscillation phenomenon of the entropy functional in the trend to equilibrium, which was suggested in the work [L. Desvillettes and C. Villani, Invent. Math., 159 (2005), pp. 245-316].
APJul 21, 2006
Fast algorithms for computing the Boltzmann collision operatorClément Mouhot, Lorenzo Pareschi
The development of accurate and fast numerical schemes for the five fold Boltzmann collision integral represents a challenging problem in scientific computing. For a particular class of interactions, including the so-called hard spheres model in dimension three, we are able to derive spectral methods that can be evaluated through fast algorithms. These algorithms are based on a suitable representation and approximation of the collision operator. Explicit expressions for the errors in the schemes are given and spectral accuracy is proved. Parallelization properties and adaptivity of the algorithms are also discussed.