NANov 25, 2016
Fast Langevin based algorithm for MCMC in high dimensionsAlain Durmus, Gareth O. Roberts, Gilles Vilmart et al.
We introduce new Gaussian proposals to improve the efficiency of the standard Hastings-Metropolis algorithm in Markov chain Monte Carlo (MCMC) methods, used for the sampling from a target distribution in large dimension $d$. The improved complexity is $\mathcal{O}(d^{1/5})$ compared to the complexity $\mathcal{O}(d^{1/3})$ of the standard approach. We prove an asymptotic diffusion limit theorem and show that the relative efficiency of the algorithm can be characterised by its overall acceptance rate (with asymptotical value 0.704), independently of the target distribution. Numerical experiments confirm our theoretical findings.
NAJun 26, 2018
Optimal explicit stabilized integrator of weak order one for stiff and ergodic stochastic differential equationsAssyr Abdulle, Ibrahim Almuslimani, Gilles Vilmart
A new explicit stabilized scheme of weak order one for stiff and ergodic stochastic differential equations (SDEs) is introduced. In the absence of noise, the new method coincides with the classical deterministic stabilized scheme (or Chebyshev method) for diffusion dominated advection-diffusion problems and it inherits its optimal stability domain size that grows quadratically with the number of internal stages of the method. For mean-square stable stiff stochastic problems, the scheme has an optimal extended mean-square stability domain that grows at the same quadratic rate as the deterministic stability domain size in contrast to known existing methods for stiff SDEs [A. Abdulle and T. Li. Commun. Math. Sci., 6(4), 2008, A. Abdulle, G. Vilmart, and K. C. Zygalakis, SIAM J. Sci. Comput., 35(4), 2013]. Combined with postprocessing techniques, the new methods achieve a convergence rate of order two for sampling the invariant measure of a class of ergodic SDEs, achieving a stabilized version of the non-Markovian scheme introduced in [B. Leimkuhler, C. Matthews, and M. V. Tretyakov, Proc. R. Soc. A, 470, 2014].
NAJan 10, 2019
A new class of uniformly accurate numerical schemes for highly oscillatory evolution equationsPhilippe Chartier, Mohammed Lemou, Florian Méhats et al.
We introduce a new methodology to design uniformly accurate methods for oscillatory evolution equations. The targeted models are envisaged in a wide spectrum of regimes, from non-stiff to highly-oscillatory. Thanks to an averaging transformation, the stiffness of the problem is softened, allowing for standard schemes to retain their usual orders of convergence. Overall, high-order numerical approximations are obtained with errors and at a cost independent of the regime.
NAMay 27, 2016
High-order integrator for sampling the invariant distribution of a class of parabolic SPDEs with additive space-time noiseCharles-Edouard Bréhier, Gilles Vilmart
We introduce a time-integrator to sample with high order of accuracy the invariant distribution for a class of semilinear SPDEs driven by an additive space-time noise. Combined with a postprocessor, the new method is a modification with negligible overhead of the standard linearized implicit Euler-Maruyama method. We first provide an analysis of the integrator when applied for SDEs (finite dimension), where we prove that the method has order $2$ for the approximation of the invariant distribution, instead of $1$. We then perform a stability analysis of the integrator in the semilinear SPDE context, and we prove in a linear case that a higher order of convergence is achieved. Numerical experiments, including the semilinear heat equation driven by space-time white noise, confirm the theoretical findings and illustrate the efficiency of the approach.
NAJul 20, 2018
Highly-oscillatory problems with time-dependent vanishing frequencyPhilippe Chartier, Mohammed Lemou, Florian Méhats et al.
In the analysis of highly-oscillatory evolution problems, it is commonly assumed that a single frequency is present and that it is either constant or, at least, bounded from below by a strictly positive constant uniformly in time. Allowing for the possibility that the frequency actually depends on time and vanishes at some instants introduces additional difficulties from both the asymptotic analysis and numerical simulation points of view. This work is a first step towards the resolution of these difficulties. In particular, we show that it is still possible in this situation to infer the asymptotic behaviour of the solution at the price of more intricate computations and we derive a second order uniformly accurate numerical method.
NANov 20, 2015
Asymptotic Preserving numerical schemes for multiscale parabolic problemsNicolas Crouseilles, Mohammed Lemou, Gilles Vilmart
We consider a class of multiscale parabolic problems with diffusion coefficients oscillating in space at a possibly small scale $\varepsilon$. Numerical homogenization methods are popular for such problems, because they capture efficiently the asymptotic behaviour as $\varepsilon \rightarrow 0$, without using a dramatically fine spatial discretization at the scale of the fast oscillations. However, known such homogenization schemes are in general not accurate for both the highly oscillatory regime $\varepsilon \rightarrow 0$ and the non oscillatory regime $\varepsilon \sim 1$. In this paper, we introduce an Asymptotic Preserving method based on an exact micro-macro decomposition of the solution which remains consistent for both regimes.
31.5NAApr 3
Spectral Deferred Corrections in the framework of Runge-Kutta methodsEugen Bronasco, Joscha Fregin, Daniel Ruprecht et al.
We interpret a wide range of flavors of Spectral Deferred Corrections (SDC) as Runge-Kutta methods (RKM). Using Butcher series, we show that the considered class of SDC methods achieve at least order p after p iterations compared to the underlying RKM, independently of the error discretisation chosen and the choice of nodes. For all collocation RKM, we analyse the phenomenon of order jumps in SDC iterations, where the order is increased by two at each iteration. We prove that it can be obtained by using appropriate inconsistent, implicit, parallelisable error discretisations. We also investigate the stability properties of the new SDC methods which can in general reduce to that of explicit RKM, but it can be improved by suitable combinations of error discretisations. We confirm the convergence analysis with numerical experiments and we apply relaxation RKM to derive SDC variants that conserve quadratic invariants.
19.2SCApr 28
Arboretum.hs: Symbolic manipulation for algebras of graphsEugen Bronasco, Jean-Luc Falcone, Gilles Vilmart
We design the Arboretum.hs package for symbolic computations with algebras of trees and more general graphs in Haskell. Thanks to the declarative nature of functional programming, the package's implementation closely follows mathematical definitions, making the code intuitive and transparent for users working with algebraic and combinatorial structures. To assist with current mathematical research, Arboretum.hs supports experimentation by facilitating the introduction of new algebraic operations, as well as providing functionality for rendering trees and forests through LaTeX integration. Compared to recent imperative implementations in languages such as Julia or Python, Arboretum.hs offers greater flexibility for manipulating and extending tree-based structures. Its use of Haskell enables safe programming and strong compile-time guarantees, serving both as a practical computational tool and a foundation for further research in algebraic combinatorics, beyond the setting of trees usually considered in the implementation of Butcher series, which are a fundamental tool for the analysis of numerical integrators.
NAApr 21, 2019
Accelerated convergence to equilibrium and reduced asymptotic variance for Langevin dynamics using Stratonovich perturbationsAssyr Abdulle, Grigorios A. Pavliotis, Gilles Vilmart
In this paper we propose a new approach for sampling from probability measures in, possibly, high dimensional spaces. By perturbing the standard overdamped Langevin dynamics by a suitable Stratonovich perturbation that preserves the invariant measure of the original system, we show that accelerated convergence to equilibrium and reduced asymptotic variance can be achieved, leading, thus, to a computationally advantageous sampling algorithm. The new perturbed Langevin dynamics is reversible with respect to the target probability measure and, consequently, does not suffer from the drawbacks of the nonreversible Langevin samplers that were introduced in~[C.-R. Hwang, S.-Y. Hwang-Ma, and S.-J. Sheu, Ann. Appl. Probab. 1993] and studied in, e.g. [T. Lelievre, F. Nier, and G. A. Pavliotis J. Stat. Phys., 2013] and [A. B. Duncan, T. Lelièvre, and G. A. Pavliotis J. Stat. Phys., 2016], while retaining all of their advantages in terms of accelerated convergence and reduced asymptotic variance. In particular, the reversibility of the dynamics ensures that there is no oscillatory transient behaviour. The improved performance of the proposed methodology, in comparison to the standard overdamped Langevin dynamics and its nonreversible perturbation, is illustrated on an example of sampling from a two-dimensional warped Gaussian target distribution.
NANov 12, 2014
Postprocessed integrators for the high order integration of ergodic SDEsGilles Vilmart
The concept of effective order is a popular methodology in the deterministic literature for the construction of efficient and accurate integrators for differential equations over long times. The idea is to enhance the accuracy of a numerical method by using an appropriate change of variables called the processor. We show that this technique can be extended to the stochastic context for the construction of new high order integrators for the sampling of the invariant measure of ergodic systems. The approach is illustrated with modifications of the stochastic $θ$-method applied to Brownian dynamics, where postprocessors achieving order two are introduced. Numerical experiments, including stiff ergodic systems, illustrate the efficiency and versatility of the approach.
NANov 13, 2006
Symplectic integrators in sub-Riemannian geometry: the Martinet caseMonique Chyba, Ernst Hairer, Gilles Vilmart
We compare the performances of symplectic and non-symplectic integrators for the computation of normal geodesics and conjugate points in sub-Riemannian geometry at the example of the Martinet case. For this case study we consider first the flat metric, and then a one parameter perturbation leading to non integrable geodesics. From our computations we deduce that near the abnormal directions a symplectic method is much more efficient for this optimal control problem. The explanation relies on the theory of backward error analysis in geometric numerical integration.