OCAug 1, 2018
An Open Newton Method for Piecewise Smooth FunctionsManuel Radons, Lutz Lehmann, Tom Streubel et al.
Recent research has shown that piecewise smooth (PS) functions can be approximated by piecewise linear functions with second order error in the distance to a given reference point. A semismooth Newton type algorithm based on successive application of these piecewise linearizations was subsequently developed for the solution of PS equation systems. For local bijectivity of the linearization at a root, a radius of quadratic convergence was explicitly calculated in terms of local Lipschitz constants of the underlying PS function. In the present work we relax the criterium of local bijectivity of the linearization to local openness. For this purpose a weak implicit function theorem is proved via local mapping degree theory. It is shown that there exist PS functions $f:\mathbb R^2\rightarrow\mathbb R^2$ satisfying the weaker criterium where every neighborhood of the root of $f$ contains a point $x$ such that all elements of the Clarke Jacobian at $x$ are singular. In such neighborhoods the steps of classical semismooth Newton are not defined, which establishes the new method as an independent algorithm. To further clarify the relation between a PS function and its piecewise linearization, several statements about structure correspondences between the two are proved. Moreover, the influence of the specific representation of the local piecewise linear models on the robustness of our method is studied. An example application from cardiovascular mathematics is given.
NASep 30, 2010
Higher-order derivatives of the QR and of the real symmetric eigenvalue decomposition in forward and reverse mode algorithmic differentiationSebastian F. Walter, Lutz Lehmann, René Lamour
We address the task of higher-order derivative evaluation of computer programs that contain QR decompositions and real symmetric eigenvalue decompositions. The approach is a combination of univariate Taylor polynomial arithmetic and matrix calculus in the (combined) forward/reverse mode of Algorithmic Differentiation (AD). Explicit algorithms are derived and presented in an accessible form. The approach is illustrated via examples.
NAAug 11, 2017
Piecewise linear secant approximation via Algorithmic Piecewise DifferentiationAndreas Griewank, Tom Streubel, Lutz Lehmann et al.
It is shown how piecewise differentiable functions $F: \mathbb R^n \mapsto \mathbb R^m $ that are defined by evaluation programs can be approximated locally by a piecewise linear model based on a pair of sample points $\check x$ and $\hat x$. We show that the discrepancy between function and model at any point $x$ is of the bilinear order $O(\|x-\check x\| \|x-\hat x\|)$. This is a little surprising since $x \in \mathbb R^n$ may vary over the whole Euclidean space, and we utilize only two function samples $\check F=F(\check x)$ and $\hat F=F(\hat x)$, as well as the intermediates computed during their evaluation. As an application of the piecewise linearization procedure we devise a generalized Newton's method based on successive piecewise linearization and prove for it sufficient conditions for convergence and convergence rates equaling those of semismooth Newton. We conclude with the derivation of formulas for the numerically stable implementation of the aforedeveloped piecewise linearization methods.