Regularized dynamical parametric approximation
This addresses the challenge of stable numerical approximation in irregular parametrizations for researchers in computational mathematics and physics, though it is incremental as it builds on existing regularization techniques.
The paper tackles the problem of approximating evolution equations using nonlinear parametrizations that can be irregular, by deriving a regularized approach that accounts for the interplay between regularization and time discretization. It demonstrates successful application in irregular scenarios, such as quantum dynamics with Gaussian sums and neural networks for ODE flow maps, with theoretical case studies and numerical experiments.
This paper studies the numerical approximation of evolution equations by nonlinear parametrizations $u(t)=Φ(\param(t))$ with time-dependent parameters $\param(t)$, which are to be determined in the computation. The motivation comes from approximations in quantum dynamics by multiple Gaussians and approximations of various dynamical problems by tensor networks and neural networks. In all these cases, the parametrization is typically irregular: the derivative $Φ'(\param)$ can have arbitrarily small singular values and may have varying rank. We derive approximation results for a regularized approach in the time-continuous case as well as in time-discretized cases. For the latter, there is a nontrivial interplay between the regularization parameter and the time stepsize, depending also on the defect size and local bounds of the second derivative of the parametrization map $Φ$. When this is appropriately taken into account, the approach can be successfully applied in irregular situations, even though it runs counter to the basic principle in numerical analysis to avoid solving ill-posed subproblems when aiming for a stable algorithm. The paper also includes two theoretical case studies: regularized parametric steepest descent for optimization and regularized parametric Strang splitting for the time-dependent Schrödinger equation. Numerical experiments with sums of Gaussians for approximating quantum dynamics and with neural networks for approximating the flow map of a system of ordinary differential equations illustrate and complement the theoretical results.