9.2NAApr 2, 2010
Reduced basis techniques for stochastic problemsSébastien Boyaval, Claude Le Bris, Tony Lelièvre et al.
We report here on the recent application of a now classical general reduction technique, the Reduced-Basis approach initiated in [C. Prud'homme, D. Rovas, K. Veroy, Y. Maday, A. T. Patera, and G. Turinici. Reliable real-time solution of parametrized partial differential equations: Reduced-basis output bounds methods. Journal of Fluids Engineering, 124(1):7080, 2002.], to the specific context of differential equations with random coefficients. After an elementary presentation of the approach, we review two contributions of the authors: [S. Boyaval, C. Le Bris, Y. Maday, N.C. Nguyen, and A.T. Patera. A reduced basis approach for variational problems with stochastic parameters: Application to heat conduction with variable Robin co-efficient. Computer Methods in Applied Mechanics and Engineering, 198(4144):3187-3206, 2009.], which presents the application of the RB approach for the discretization of a simple second order elliptic equation supplied with a random boundary condition, and [S. Boyaval and T. Lelièvre, A variance reduction method for parametrized stochastic differential equations using the reduced basis paradigm with T. Lelièvre, Commun. Math. Sci. 8, special Issue "Mathematical Issue on Complex Fluids" P. Zhang ed., to appear, 2010, ARXIV preprint arXiv:0906.3600], which uses a RB type approach to reduce the variance in the Monte-Carlo simulation of a stochastic differential equation. We conclude the review with some general comments and also discuss possible tracks for further research in the direction.
6.6NANov 4, 2008
Results and questions on a nonlinear approximation approach for solving high-dimensional partial differential equationsC. Le Bris, T. Lelievre, Y. Maday
We investigate mathematically a nonlinear approximation type approach recently introduced in [A. Ammar et al., J. Non-Newtonian Fluid Mech., 2006] to solve high dimensional partial differential equations. We show the link between the approach and the greedy algorithms of approximation theory studied e.g. in [R.A. DeVore and V.N. Temlyakov, Adv. Comput. Math., 1996]. On the prototypical case of the Poisson equation, we show that a variational version of the approach, based on minimization of energies, converges. On the other hand, we show various theoretical and numerical difficulties arising with the non variational version of the approach, consisting of simply solving the first order optimality equations of the problem. Several unsolved issues are indicated in order to motivate further research.
1.2NAJan 28, 2015
Long-time convergence of an adaptive biasing force method: Variance reduction by Helmholtz projectionHoussam Alrachid, Tony Lelièvre
In this paper, we propose an improvement of the adaptive biasing force (ABF) method, by projecting the estimated mean force onto a gradient. The associated stochastic process satisfies a non linear stochastic differential equation. Using entropy techniques, we prove exponential convergence to the stationary state of this stochastic process. We finally show on some numerical examples that the variance of the approximated mean force is reduced using this technique, which makes the algorithm more efficient than the standard ABF method.
7.3NAJan 15, 2008
Free-energy-dissipative schemes for the Oldroyd-B modelSébastien Boyaval, Tony Lelièvre, Claude Mangoubi
In this article, we analyze the stability of various numerical schemes for differential models of viscoelastic fluids. More precisely, we consider the prototypical Oldroyd-B model, for which a free energy dissipation holds, and we show under which assumptions such a dissipation is also satisfied for the numerical scheme. Among the numerical schemes we analyze, we consider some discretizations based on the log-formulation of the Oldroyd-B system proposed by Fattal and Kupferman, which have been reported to be numerically more stable than discretizations of the usual formulation in some benchmark problems. Our analysis gives some tracks to understand these numerical observations.
4.3NAFeb 8, 2013
A micro-macro parareal algorithm: application to singularly perturbed ordinary differential equationsFrederic Legoll, Tony Lelievre, Giovanni Samaey
We introduce a micro-macro parareal algorithm for the time-parallel integration of multiscale-in-time systems. The algorithm first computes a cheap, but inaccurate, solution using a coarse propagator (simulating an approximate slow macroscopic model), which is iteratively corrected using a fine-scale propagator (accurately simulating the full microscopic dynamics). This correction is done in parallel over many subintervals, thereby reducing the wall-clock time needed to obtain the solution, compared to the integration of the full microscopic model. We provide a numerical analysis of the algorithm for a prototypical example of a micro-macro model, namely singularly perturbed ordinary differential equations. We show that the computed solution converges to the full microscopic solution (when the parareal iterations proceed) only if special care is taken during the coupling of the microscopic and macroscopic levels of description. The convergence rate depends on the modeling error of the approximate macroscopic model. We illustrate these results with numerical experiments.
4.3NAJan 18, 2012
Two mathematical tools to analyze metastable stochastic processesTony Lelièvre
We present how entropy estimates and logarithmic Sobolev inequalities on the one hand, and the notion of quasi-stationary distribution on the other hand, are useful tools to analyze metastable overdamped Langevin dynamics, in particular to quantify the degree of metastability. We discuss the interest of these approaches to estimate the efficiency of some classical algorithms used to speed up the sampling, and to evaluate the error introduced by some coarse-graining procedures. This paper is a summary of a plenary talk given by the author at the ENUMATH 2011 conference.
4.3FAOct 24, 2012
Greedy algorithms for high-dimensional non-symmetric linear problemsEric Cances, Virginie Ehrlacher, Tony Lelievre
In this article, we present a family of numerical approaches to solve high-dimensional linear non-symmetric problems. The principle of these methods is to approximate a function which depends on a large number of variates by a sum of tensor product functions, each term of which is iteratively computed via a greedy algorithm. There exists a good theoretical framework for these methods in the case of (linear and nonlinear) symmetric elliptic problems. However, the convergence results are not valid any more as soon as the problems considered are not symmetric. We present here a review of the main algorithms proposed in the literature to circumvent this difficulty, together with some new approaches. The theoretical convergence results and the practical implementation of these algorithms are discussed. Their behaviors are illustrated through some numerical examples.
1.2NAJan 16, 2018
Mathematical foundations of Accelerated Molecular Dynamics methodsTony Lelièvre
The objective of this review article is to present recent results on the mathematical analysis of the Accelerated Dynamics algorithms introduced by A.F. Voter in collaboration with D. Perez and M. Sorensen. Using the notion of quasi-stationary distribution, one is able to rigorously justify the fact that the exit event from a metastable state for the Langevin or overdamped Langevin dynamics can be modeled by a kinetic Monte Carlo model. Moreover, under some geometric assumptions, one can prove that this kinetic Monte Carlo model can be parameterized using Eyring-Kramers formulas. These are the building blocks required to analyze the Accelerated Dynamics algorithms, to understand their efficiency and their accuracy, and to improve and generalize these techniques beyond their original scope.
6.7MLMay 5, 2022
Generative methods for sampling transition paths in molecular dynamicsTony Lelièvre, Geneviève Robin, Inass Sekkat et al.
Molecular systems often remain trapped for long times around some local minimum of the potential energy function, before switching to another one -- a behavior known as metastability. Simulating transition paths linking one metastable state to another one is difficult by direct numerical methods. In view of the promises of machine learning techniques, we explore in this work two approaches to more efficiently generate transition paths: sampling methods based on generative models such as variational autoencoders, and importance sampling methods based on reinforcement learning.
1.2NAJan 5, 2018
Analysis of a micro-macro acceleration method with minimum relative entropy moment matchingTony Lelièvre, Giovanni Samaey, Przemysław Zieliński
We analyse convergence of a micro-macro acceleration method for the Monte Carlo simulation of stochastic differential equations with time-scale separation between the (fast) evolution of individual trajectories and the (slow) evolution of the macroscopic function of interest. We consider a class of methods, presented in [Debrabant, K., Samaey, G., Zieliński, P. A micro-macro acceleration method for the Monte Carlo simulation of stochastic differential equations. SINUM, 55 (2017) no. 6, 2745-2786], that performs short bursts of path simulations, combined with the extrapolation of a few macroscopic state variables forward in time. After extrapolation, a new microscopic state is then constructed, consistent with the extrapolated variable and minimising the perturbation caused by the extrapolation. In the present paper, we study a specific method in which this perturbation is minimised in a relative entropy sense. We discuss why relative entropy is a useful metric, both from a theoretical and practical point of view, and rigorously study local errors and numerical stability of the resulting method as a function of the extrapolation time step and the number of macroscopic state variables. Using these results, we discuss convergence to the full microscopic dynamics, in the limit when the extrapolation time step tends to zero and the number of macroscopic state variables tends to infinity.
9.7BIO-PHApr 22, 2021
Chasing Collective Variables using Autoencoders and biased trajectoriesZineb Belkacemi, Paraskevi Gkeka, Tony Lelièvre et al.
Free energy biasing methods have proven to be powerful tools to accelerate the simulation of important conformational changes of molecules by modifying the sampling measure. However, most of these methods rely on the prior knowledge of low-dimensional slow degrees of freedom, i.e. Collective Variables (CV). Alternatively, such CVs can be identified using machine learning (ML) and dimensionality reduction algorithms. In this context, approaches where the CVs are learned in an iterative way using adaptive biasing have been proposed: at each iteration, the learned CV is used to perform free energy adaptive biasing to generate new data and learn a new CV. In this paper, we introduce a new iterative method involving CV learning with autoencoders: Free Energy Biasing and Iterative Learning with AutoEncoders (FEBILAE). Our method includes a reweighting scheme to ensure that the learning model optimizes the same loss at each iteration, and achieves CV convergence. Using the alanine dipeptide system and the solvated chignolin mini-protein system as examples, we present results of our algorithm using the extended adaptive biasing force as the free energy adaptive biasing method.
4.3NASep 30, 2009
A Variance Reduction Method for Parametrized Stochastic Differential Equations using the Reduced Basis ParadigmSebastien Boyaval, Tony Lelievre
In this work, we develop a reduced-basis approach for the efficient computation of parametrized expected values, for a large number of parameter values, using the control variate method to reduce the variance. Two algorithms are proposed to compute online, through a cheap reduced-basis approximation, the control variates for the computation of a large number of expectations of a functional of a parametrized Ito stochastic process (solution to a parametrized stochastic differential equation). For each algorithm, a reduced basis of control variates is pre-computed offline, following a so-called greedy procedure, which minimizes the variance among a trial sample of the output parametrized expectations. Numerical results in situations relevant to practical applications (calibration of volatility in option pricing, and parameter-driven evolution of a vector field following a Langevin equation from kinetic theory) illustrate the efficiency of the method.
2.3NAMar 14, 2007
Diffusion Monte Carlo method: numerical analysis in a simple caseTony Lelievre, Mohamed El Makrini, Benjamin Jourdain
The Diffusion Monte Carlo method is devoted to the computation of electronic ground-state energies of molecules. In this paper, we focus on implementations of this method which consist in exploring the configuration space with a {\bf fixed} number of random walkers evolving according to a Stochastic Differential Equation discretized in time. We allow stochastic reconfigurations of the walkers to reduce the discrepancy between the weights that they carry. On a simple one-dimensional example, we prove the convergence of the method for a fixed number of reconfigurations when the number of walkers tends to $+\infty$ while the timestep tends to 0. We confirm our theoretical rates of convergence by numerical experiments. Various resampling algorithms are investigated, both theoretically and numerically
5.1NAMar 7, 2007
New entropy estimates for the Oldroyd-B model, and related modelsDan Hu, Tony Lelievre
This short note presents the derivation of a new {\it a priori} estimate for the Oldroyd-B model. Such an estimate may provide useful information when investigating the long-time behaviour of macro-macro models, and the stability of numerical schemes. We show how this estimate can be used as a guideline to derive new estimates for other macroscopic models, like the FENE-P model.