1.2NAFeb 27, 2017
Butcher series: A story of rooted trees and numerical methods for evolution equationsRobert I McLachlan, Klas Modin, Hans Munthe-Kaas et al.
Butcher series appear when Runge-Kutta methods for ordinary differential equations are expanded in power series of the step size parameter. Each term in a Butcher series consists of a weighted elementary differential, and the set of all such differentials is isomorphic to the set of rooted trees, as noted by Cayley in the mid 19th century. A century later Butcher discovered that rooted trees can also be used to obtain the order conditions of Runge-Kutta methods, and he found a natural group structure, today known as the Butcher group. It is now known that many numerical methods also can be expanded in Butcher series; these are called B-series methods. A long-standing problem has been to characterize, in terms of qualitative features, all B-series methods. Here we tell the story of Butcher series, stretching from the early work of Cayley, to modern developments and connections to abstract algebra, and finally to the resolution of the characterization problem. This resolution introduces geometric tools and perspectives to an area traditionally explored using analysis and combinatorics.
1.2NAJun 5, 2016
Numerical Study of Nonlinear Dispersive Wave Models with SpecTraVVaveHenrik Kalisch, Daulet Moldabayev, Olivier Verdier
In nonlinear dispersive evolution equations, the competing effects of nonlinearity and dispersion make a number of interesting phenomena possible. In the current work, the focus is on the numerical approximation of traveling-wave solutions of such equations. We describe our efforts to write a dedicated Python code which is able to compute traveling-wave solutions of nonlinear dispersive equations of the general form \begin{equation*} u_t + [f(u)]_{x} + \mathcal{L} u_x = 0, \end{equation*} where $\mathcal{L}$ is a self-adjoint operator, and $f$ is a real-valued function with $f(0) = 0$. The SpectraVVave code uses a continuation method coupled with a spectral projection to compute approximations of steady symmetric solutions of this equation. The code is used in a number of situations to gain an understanding of traveling-wave solutions. The first case is the Whitham equation, where numerical evidence points to the conclusion that the main bifurcation branch features three distinct points of interest, namely a turning point, a point of stability inversion, and a terminal point which corresponds to a cusped wave. The second case is the so-called modified Benjamin-Ono equation where the interaction of two solitary waves is investigated. It is found that is possible for two solitary waves to interact in such a way that the smaller wave is annihilated. The third case concerns the Benjamin equation which features two competing dispersive operators. In this case, it is found that bifurcation curves of periodic traveling-wave solutions may cross and connect high up on the branch in the nonlinear regime.
1.2NAMay 24, 2016
Full affine equivariance and weak natural transformations in numerical analysis - the case of B-SeriesOlivier Verdier
Many algorithms in numerical analysis are affine equivariant: they are immune to changes of affine coordinates. This is because those algorithms are defined using affine invariant constructions. There is, however, a crucial ingredient missing: most algorithms are in fact defined regardless of the underlying dimension. As a result, they are also invariant with respect to non-invertible affine transformation from spaces of different dimensions. We formulate this property precisely: these algorithms fall short of being natural transformations between affine functors. We give a precise definition of what we call a weak natural transformation between functors, and illustrate the point using examples coming from numerical analysis, in particular B-Series.
1.4CVSep 26, 2022
Ablation Path SaliencyJustus Sagemüller, Olivier Verdier
Various types of saliency methods have been proposed for explaining black-box classification. In image applications, this means highlighting the part of the image that is most relevant for the current decision. Unfortunately, the different methods may disagree and it can be hard to quantify how representative and faithful the explanation really is. We observe however that several of these methods can be seen as edge cases of a single, more general procedure based on finding a particular path through the classifier's domain. This offers additional geometric interpretation to the existing methods. We demonstrate furthermore that ablation paths can be directly used as a technique of its own right. This is able to compete with literature methods on existing benchmarks, while giving more fine-grained information and better opportunities for validation of the explanations' faithfulness.
6.3IVAug 26, 2019
Spatiotemporal PET reconstruction using ML-EM with learned diffeomorphic deformationOzan Öktem, Camille Pouchol, Olivier Verdier
Patient movement in emission tomography deteriorates reconstruction quality because of motion blur. Gating the data improves the situation somewhat: each gate contains a movement phase which is approximately stationary. A standard method is to use only the data from a few gates, with little movement between them. However, the corresponding loss of data entails an increase of noise. Motion correction algorithms have been implemented to take into account all the gated data, but they do not scale well, especially not in 3D. We propose a novel motion correction algorithm which addresses the scalability issue. Our approach is to combine an enhanced ML-EM algorithm with deep learning based movement registration. The training is unsupervised, and with artificial data. We expect this approach to scale very well to higher resolutions and to 3D, as the overall cost of our algorithm is only marginally greater than that of a standard ML-EM algorithm. We show that we can significantly decrease the noise corresponding to a limited number of gates.
14.4CVAug 27, 2018
Task adapted reconstruction for inverse problemsJonas Adler, Sebastian Lunz, Olivier Verdier et al.
The paper considers the problem of performing a task defined on a model parameter that is only observed indirectly through noisy data in an ill-posed inverse problem. A key aspect is to formalize the steps of reconstruction and task as appropriate estimators (non-randomized decision rules) in statistical estimation problems. The implementation makes use of (deep) neural networks to provide a differentiable parametrization of the family of estimators for both steps. These networks are combined and jointly trained against suitable supervised training data in order to minimize a joint differentiable loss function, resulting in an end-to-end task adapted reconstruction method. The suggested framework is generic, yet adaptable, with a plug-and-play structure for adjusting both the inverse problem and the task at hand. More precisely, the data model (forward operator and statistical model of the noise) associated with the inverse problem is exchangeable, e.g., by using neural network architecture given by a learned iterative method. Furthermore, any task that is encodable as a trainable neural network can be used. The approach is demonstrated on joint tomographic image reconstruction, classification and joint tomographic image reconstruction segmentation.
1.2NAMay 5, 2012
Reduction and Normal Forms of Matrix PencilsOlivier Verdier
Matrix pencils, or pairs of matrices, may be used in a variety of applications. In particular, a pair of matrices (E,A) may be interpreted as the differential equation E x' + A x = 0. Such an equation is invariant by changes of variables, or linear combination of the equations. This change of variables or equations is associated to a group action. The invariants corresponding to this group action are well known, namely the Kronecker indices and divisors. Similarly, for another group action corresponding to the weak equivalence, a complete set of invariants is also known, among others the strangeness. We show how to define those invariants in a directly invariant fashion, i.e. without using a basis or an extra Euclidean structure. To this end, we will define a reduction process which produces a new system out of the original one. The various invariants may then be defined from operators related to the repeated application of the reduction process. We then show the relation between the invariants and the reduced subspace dimensions, and the relation with the regular pencil condition. This is all done using invariant tools only. Making special choices of basis then allows to construct the Kronecker canonical form. In a related manner, we construct the strangeness canonical form associated to weak equivalence.