4.3NAFeb 19, 2013
Discrete gradient methods have an energy conservation lawRobert I McLachlan, G R W Quispel
We show for a variety of classes of conservative PDEs that discrete gradient methods designed to have a conserved quantity (here called energy) also have a time-discrete conservation law. The discrete conservation law has the same conserved density as the continuous conservation law, while its flux is found by replacing all derivatives of the conserved density appearing in the continuous flux by discrete gradients.
1.2NAFeb 27, 2017
Butcher series: A story of rooted trees and numerical methods for evolution equationsRobert I McLachlan, Klas Modin, Hans Munthe-Kaas et al.
Butcher series appear when Runge-Kutta methods for ordinary differential equations are expanded in power series of the step size parameter. Each term in a Butcher series consists of a weighted elementary differential, and the set of all such differentials is isomorphic to the set of rooted trees, as noted by Cayley in the mid 19th century. A century later Butcher discovered that rooted trees can also be used to obtain the order conditions of Runge-Kutta methods, and he found a natural group structure, today known as the Butcher group. It is now known that many numerical methods also can be expanded in Butcher series; these are called B-series methods. A long-standing problem has been to characterize, in terms of qualitative features, all B-series methods. Here we tell the story of Butcher series, stretching from the early work of Cayley, to modern developments and connections to abstract algebra, and finally to the resolution of the characterization problem. This resolution introduces geometric tools and perspectives to an area traditionally explored using analysis and combinatorics.
1.2MATH-PHMay 18, 2019
The Lie algebra of classical mechanicsRobert I McLachlan, Ander Murua
Classical mechanical systems are defined by their kinetic and potential energies. They generate a Lie algebra under the canonical Poisson bracket. This Lie algebra, which is usually infinite dimensional, is useful in analyzing the system, as well as in geometric numerical integration. But because the kinetic energy is quadratic in the momenta, the Lie algebra obeys identities beyond those implied by skew symmetry and the Jacobi identity. Some Poisson brackets, or combinations of brackets, are zero for all choices of kinetic and potential energy, regardless of the dimension of the system. Therefore, we study the universal object in this setting, the `Lie algebra of classical mechanics' modelled on the Lie algebra generated by kinetic and potential energy of a simple mechanical system with respect to the canonical Poisson bracket. We show that it is the direct sum of an abelian algebra $\mathcal X$, spanned by `modified' potential energies isomorphic to the free commutative nonassociative algebra with one generator, and an algebra freely generated by the kinetic energy and its Poisson bracket with $\mathcal X$. We calculate the dimensions $c_n$ of its homogeneous subspaces and determine the value of its entropy $\lim_{n\to\infty} c_n^{1/n}$. It is $1.8249\dots$, a fundamental constant associated to classical mechanics. We conjecture that the class of systems with Euclidean kinetic energy metrics is already free, i.e., the only linear identities satisfied by the Lie brackets of all such systems are those satisfied by the Lie algebra of classical mechanics.
1.2NAMar 15, 2018
Parallelisation, initialisation, and boundary treatments for the diamond schemeStephen R Marsland, Robert I McLachlan, Matthew C Wilkins
We study a class of general purpose linear multisymplectic integrators for Hamiltonian wave equations based on a diamond-shaped mesh. On each diamond, the PDE is discretized by a symplectic Runge--Kutta method. The scheme advances in time by filling in each diamond locally. We demonstrate that this leads to greater efficiency and parallelization and easier treatment of boundary conditions compared to methods based on rectangular meshes. We develop a variety of initial and boundary value treatments and present numerical evidence of their performance. In all cases, the observed order of convergence is equal to or greater than the number of stages of the underlying Runge--Kutta method.
13.6LGJun 5, 2020
Structure preserving deep learningElena Celledoni, Matthias J. Ehrhardt, Christian Etmann et al.
Over the past few years, deep learning has risen to the foreground as a topic of massive interest, mainly as a result of successes obtained in solving large-scale image processing tasks. There are multiple challenging mathematical problems involved in applying deep learning: most deep learning methods require the solution of hard optimisation problems, and a good understanding of the tradeoff between computational effort, amount of data and model complexity is required to successfully design a deep learning approach for a given problem. A large amount of progress made in deep learning has been based on heuristic explorations, but there is a growing effort to mathematically understand the structure in existing deep learning methods and to systematically design new deep learning methods to preserve certain types of structure in deep learning. In this article, we review a number of these directions: some deep neural networks can be understood as discretisations of dynamical systems, neural networks can be designed to have desirable properties such as invertibility or group equivariance, and new algorithmic frameworks based on conformal Hamiltonian systems and Riemannian manifolds to solve the optimisation problems have been proposed. We conclude our review of each of these topics by discussing some open problems that we consider to be interesting directions for future research.
1.1CVMar 30, 2016
Möbius Invariants of Shapes and ImagesStephen Marsland, Robert McLachlan
Identifying when different images are of the same object despite changes caused by imaging technologies, or processes such as growth, has many applications in fields such as computer vision and biological image analysis. One approach to this problem is to identify the group of possible transformations of the object and to find invariants to the action of that group, meaning that the object has the same values of the invariants despite the action of the group. In this paper we study the invariants of planar shapes and images under the Möbius group $\mathrm{PSL}(2,\mathbb{C})$, which arises in the conformal camera model of vision and may also correspond to neurological aspects of vision, such as grouping of lines and circles. We survey properties of invariants that are important in applications, and the known Möbius invariants, and then develop an algorithm by which shapes can be recognised that is Möbius- and reparametrization-invariant, numerically stable, and robust to noise. We demonstrate the efficacy of this new invariant approach on sets of curves, and then develop a Möbius-invariant signature of grey-scale images.
1.2NAOct 27, 2015
Travelling wave solutions of multisymplectic discretizations of semi-linear wave equationsFleur McDonald, Robert I McLachlan, Brian E Moore et al.
How well do multisymplectic discretisations preserve travelling wave solutions? To answer this question, the 5-point central difference scheme is applied to the semi-linear wave equation. A travelling wave ansatz leads to an ordinary difference equation, whose solutions correspond to the numerical scheme and can be compared to travelling wave solutions of the corresponding PDE. For a discontinuous nonlinearity the difference equation is solved exactly. For continuous nonlinearities the difference equation is solved using a Fourier series, and resonances that depend on the grid-size are revealed for a smooth nonlinearity. In general, the infinite dimensional functional equation, which must be solved to get the travelling wave solutions, is intractable, but backward error analysis proves to be a powerful tool, as it provides a way to study the solutions of the equation through a simple ODE that describes the behavior to arbitrarily high order. A general framework for using backward error analysis to analyze preservation of travelling waves for other equations and discretisations is presented. Then, the advantages that multisymplectic methods have over other methods are briefly highlighted.