Timm Faulwasser

Ruchuan Ou, Learta Januzi, Jonas Schießl et al.

The consideration of stochastic uncertainty in optimal and predictive control is a well-explored topic. Recently Polynomial Chaos Expansions (PCE) have received considerable attention for problems involving stochastically uncertain system parameters and also for problems with additive stochastic i.i.d. disturbances. While there exist a number of open-source PCE toolboxes, tailored open-source codes for the solution of OCPs involving additive stochastic i.i.d. disturbances in julia are not available. Hence, this paper introduces the toolbox PolyOCP$.$jl which enables to efficiently solve stochastic OCPs for linear systems subject to a large class of disturbance distributions. We explain the main mathematical concepts between the PCE transcription of stochastic OCPs and how they are provided in the toolbox. We draw upon two examples to illustrate the functionalities of PolyOCP$.$jl.

Timm Faulwasser, Rolf Findeisen

We consider the tracking of geometric paths in output spaces of nonlinear systems subject to input and state constraints without pre-specified timing requirements. Such problems are commonly referred to as constrained output path-following problems. Specifically, we propose a predictive control approach to constrained path-following problems with and without velocity assignments and provide sufficient convergence conditions based on terminal regions and end penalties. Furthermore, we analyze the geometric nature of constrained output path-following problems and thereby provide insight into the computation of suitable terminal control laws and terminal regions. We draw upon an example from robotics to illustrate our findings.

Alexander Engelmann, Yuning Jiang, Tillmann Mühlpfordt et al.

The present paper discusses the application of the recently proposed Augmented Lagrangian Alternating Direction Inexact Newton (ALADIN) method to non-convex AC Optimal Power Flow Problems (OPF) in a distributed fashion. In contrast to the often used Alternating Direction of Multipliers Method (ADMM), ALADIN guarantees locally quadratic convergence for AC OPF. Numerical results for 5 to 300 bus test cases indicate that ALADIN is able to outperform ADMM and to reduce the number of iterations by about one order of magnitude. We compare ALADIN to numerical results for ADMM documented in the literature. The improved convergence speed comes at the cost of increasing the communication effort per iteration. Therefore, we propose a variant of ALADIN that uses inexact Hessians to reduce communication. Additionally, we provide a detailed comparison of these ALADIN variants to ADMM from an algorithmic and communication perspective. Moreover, we prove that ALADIN converges locally at quadratic rate even for the relevant case of suboptimally solved local NLPs.

Tillmann Mühlpfordt, Rolf Findeisen, Veit Hagenmeyer et al.

Methods based on polynomial chaos expansion allow to approximate the behavior of systems with uncertain parameters by deterministic dynamics. These methods are used in a wide range of applications, spanning from simulation of uncertain systems to estimation and control. For practical purposes the exploited spectral series expansion is typically truncated to allow for efficient computation, which leads to approximation errors. Despite the Hilbert space nature of polynomial chaos, there are only a few results in the literature that explicitly discuss and quantify these approximation errors. This work derives error bounds for polynomial chaos approximations of polynomial and non-polynomial mappings. Sufficient conditions are established, which allow investigating the question whether zero truncation errors can be achieved and which series order is required to achieve this. Furthermore, convex quadratic programs, whose argmin operator is a special case of a piecewise polynomial mapping, are studied due to their relevance in predictive control. Several simulation examples illustrate our findings.

Christopher M. Kellett, Steven R. Weller, Timm Faulwasser et al.

For his work in the economics of climate change, Professor William Nordhaus was a co-recipient of the 2018 Nobel Memorial Prize for Economic Sciences. A core component of the work undertaken by Nordhaus is the Dynamic Integrated model of Climate and Economy, known as the DICE model. The DICE model is a discrete-time model with two control inputs and is primarily used in conjunction with a particular optimal control problem in order to estimate optimal pathways for reducing greenhouse gas emissions. In this paper, we provide a tutorial introduction to the DICE model and we indicate challenges and open problems of potential interest for the systems and control community.

Alexander Engelmann, Yuning Jiang, Boris Houska et al.

Decentralized optimization algorithms are important in different contexts, such as distributed optimal power flow or distributed model predictive control, as they avoid central coordination and enable decomposition of large-scale problems. In case of constrained non-convex optimization only a few algorithms are currently are available; often their performance is limited, or they lack convergence guarantees. This paper proposes a framework for decentralized non-convex optimization via bi-level distribution of the Augmented Lagrangian Alternating Direction Inexact Newton (ALADIN) algorithm. Bi-level distribution means that the outer ALADIN structure is combined with an inner distribution/decentralization level solving a condensed variant of ALADIN's convex coordination QP by decentralized algorithms. We prove sufficient conditions ensuring local convergence while allowing for inexact decentralized/distributed solutions of the coordination QP. Moreover, we show how a decentralized variant of conjugate gradient or decentralized ADMM schemes can be employed at the inner level. We draw upon case studies from power systems and robotics to illustrate the performance of the proposed framework.

Tillmann Mühlpfordt, Timm Faulwasser, Veit Hagenmeyer

Deregulated energy markets, demand forecasting, and the continuously increasing share of renewable energy sources call---among others---for a structured consideration of uncertainties in optimal power flow problems. The main challenge is to guarantee power balance while maintaining economic and secure operation. In the presence of Gaussian uncertainties affine feedback policies are known to be viable options for this task. The present paper advocates a general framework for chance-constrained OPF problems in terms of continuous random variables. It is shown that, irrespective of the type of distribution, the random-variable minimizers lead to affine feedback policies. Introducing a three-step methodology that exploits polynomial chaos expansion, the present paper provides a constructive approach to chance-constrained optimal power flow problems that does not assume a specific distribution, e.g. Gaussian, for the uncertainties. We illustrate our findings by means of a tutorial example and a 300-bus test case.

Ruchuan Ou, Guanru Pan, Timm Faulwasser

Recently, the fundamental lemma by Willems et al. has been extended towards stochastic LTI systems subject to process disturbances. Using this lemma requires previously recorded data of inputs, outputs, and disturbances. In this paper, we exploit causality concepts of stochastic control to propose a variant of the stochastic fundamental lemma that does not require past disturbance data in the Hankel matrices. Our developments rely on polynomial chaos expansions and on the knowledge of the disturbance distribution. Similar to our previous results, the proposed variant of the fundamental lemma allows to predict future input-output trajectories of stochastic LTI systems. We draw upon a numerical example to illustrate the proposed variant in data-driven control context.

Timm Faulwasser, Alexander Engelmann, Tillmann Mühlpfordt et al.

The Energiewende is a paradigm change that can be witnessed at latest since the political decision to step out of nuclear energy. Moreover, despite common roots in Electrical Engineering, the control community and the power systems community face a lack of common vocabulary. In this context, this paper aims at providing a systems-and-control specific introduction to optimal power flow problems which are pivotal in the operation of energy systems. Based on a concise problem statement, we introduce a common description of optimal power flow variants including multi-stage-problems and predictive control, stochastic uncertainties, and issues of distributed optimization. Moreover, we sketch open questions that might be of interest for the systems and control community.

Xu Du, Alexander Engelmann, Yuning Jiang et al.

This paper proposes a structure exploiting algorithm for solving non-convex power system state estimation problems in distributed fashion. Because the power flow equations in large electrical grid networks are non-convex equality constraints, we develop a tailored state estimator based on Augmented Lagrangian Alternating Direction Inexact Newton (ALADIN) method, which can handle the nonlinearities efficiently. Here, our focus is on using Gauss-Newton Hessian approximations within ALADIN in order to arrive at at an efficient (computationally and communicationally) variant of ALADIN for network maximum likelihood estimation problems. Analyzing the IEEE 30-Bus system we illustrate how the proposed algorithm can be used to solve highly non-trivial network state estimation problems. We also compare the method with existing distributed parameter estimation codes in order to illustrate its performance.

Tillmann Mühlpfordt, Veit Hagenmeyer, Timm Faulwasser

The operation of power systems has become more challenging due to feed-in of volatile renewable energy sources. Chance-constrained optimal power flow (ccOPF) is one possibility to explicitly consider volatility via probabilistic uncertainties resulting in mean-optimal feedback policies. These policies are computed before knowledge of the realization of the uncertainty is available. On the other hand, the hypothetical case of computing the power injections knowing every realization beforehand---called in-hindsight OPF(hOPF)---cannot be outperformed w.r.t. costs and constraint satisfaction. In this paper, we investigate how ccOPF feedback relates to the full-information hOPF. To this end, we introduce different dimensions of the price of uncertainty. Using mild assumptions on the uncertainty we present sufficient conditions when ccOPF is identical to hOPF. We suggest using the total variational distance of probability densities to quantify the performance gap of hOPF and ccOPF. Finally, we draw upon a tutorial example to illustrate our results.

Sophie Hall, Florian Dörfler, Timm Faulwasser

Generalized Nash equilibria are used in multi-agent control applications to model strategic interactions between agents that are coupled in the cost, dynamics, and constraints, and provide the foundations for game-theoretic MPC (Receding Horizon Games). We study properties of finite-horizon dynamic GNE trajectories from a system-theoretic perspective. We show how strict dissipativity generates the turnpike phenomenon in GNE solutions. Moreover, we establish a converse turnpike result, i.e., the implication from turnpike to strict dissipativity. We derive conditions under which the steady-state GNE is the optimal operating point and, using a game value function, we give a local characterization of the geometry of storage functions. Finally, we design linear terminal penalties that ensure dynamic GNE trajectories applied in open-loop converge to and remain at the steady-state GNE. These connections provide the foundation for future system-theoretic analysis of GNEs similar to those existing in optimal control as well as for recursive feasibility and closed-loop stability results of game-theoretic MPC.

Timm Faulwasser, Alexander Engelmann

Recently there has been considerable progress on the analysis of stability and performance properties of so-called economic Nonlinear Model Predictive Control (NMPC) schemes; i.e. NMPC schemes employing stage costs that are not directly related to distance measures of pre-computed setpoints. At the same time, with respect to the energy transition, the use of NMPC schemes is proposed and investigated in a plethora of papers in different contexts. For example receding-horizon approaches to generator dispatch problems, which is also known as multi-stage Optimal Power Flow (OPF), naturally lead to economic NMPC schemes based on non-convex discrete-time Optimal Control Problems (OCP). The present paper investigates the transfer of analytic results available for general economic NMPC schemes to receding-horizon multistage OPF. We propose a blueprint formulation of multi-stage opf including AC power flow equations. Based on this formulation we present results on the dissipativity and recursive feasibility properties of the underlying OCP. Finally, we draw upon simulations using a 5 bus system and a 118 bus system to illustrate our findings.

Guanru Pan, Dirk Reinhardt, Sebastien Gros et al.

This paper presents a data-driven framework for uncertainty propagation under unmeasured or statistically unmodeled (unstructured) disturbances. We consider residual disturbances, which consolidate all unstructured disturbances into a single quantity that can be estimated from data. Under mild assumptions, the resulting stochastic predictor is causal and distributionally consistent, enabling efficient uncertainty quantification through polynomial chaos expansions and higher-order Chebyshev inequalities. The proposed method is validated using experimental data from a smart home in Norway.

Sophie Hall, Florian Dörfler, Timm Faulwasser

We analyze Receding Horizon Games without any MPC-like terminal ingredients. We show that recursive feasibility can be inferred from the turnpike phenomenon under mild assumptions. Moreover, we prove sufficient conditions for practical asymptotic convergence of the closed-loop trajectories, and we discuss how the gap towards practical asymptotic stability may be closed. We use numerical examples to show that the closed-loop region of attraction around the steady-state GNE shrinks exponentially with the horizon length, a behavior previously known only for model predictive control. Further, we apply a linear end penalty and demonstrate in numerical simulations that it suppresses the leaving arc and ensures asymptotic convergence to the steady-state GNE.

Johannes Teutsch, Oleksii Molodchyk, Marion Leibold et al.

Providing non-conservative uncertainty quantification for function estimates derived from noisy observations remains a fundamental challenge in statistical machine learning, particularly for applications in safety-critical domains. In this work, we propose novel non-asymptotic probabilistic uniform error bounds for kernel-based regression. Compared to related bounds in the literature that are restricted to (conditionally) independent sub-Gaussian noise, our bounds allow to consider a broad class of non-Gaussian distributions, such as sub-Gaussian, bounded, sub-exponential, and variance/moment-bounded noise. Moreover, our results apply to correlated and uncorrelated noise. We compare our proposed error bounds with existing results in terms of the induced uncertainty region and their performance in safe control, demonstrating the tightness of the proposed bounds.

Oleksii Molodchyk, Timm Faulwasser

Generalizations and variations of the fundamental lemma by Willems et al. are an active topic of recent research. In this note, we explore and formalize the links between kernel regression and some known nonlinear extensions of the fundamental lemma. Applying a transformation to the usual linear equation in Hankel matrices, we arrive at an alternative implicit kernel representation of the system trajectories while keeping the requirements on persistency of excitation. We show that this representation is equivalent to the solution of a specific kernel regression problem. We explore the possible structures of the underlying kernel as well as the system classes to which they correspond.

Oleksii Molodchyk, Johannes Teutsch, Timm Faulwasser

Bayesian Optimization (BO) is a data-driven strategy for minimizing/maximizing black-box functions based on probabilistic surrogate models. In the presence of safety constraints, the performance of BO crucially relies on tight probabilistic error bounds related to the uncertainty surrounding the surrogate model. For the case of Gaussian Process surrogates and Gaussian measurement noise, we present a novel error bound based on the recently proposed Wiener kernel regression. We prove that under rather mild assumptions, the proposed error bound is tighter than bounds previously documented in the literature, leading to enlarged safety regions. We draw upon a numerical example to demonstrate the efficacy of the proposed error bound in safe BO.

Oleksii Molodchyk, Omid Mokhtari, Samuel Chevalier et al.

Real-time control of distribution networks requires accurate information about the system state. In practice, however, such information is difficult to obtain because real-time measurements are available only at a limited number of locations. This paper proposes a novel data-driven power flow (DDPF) framework for balanced radial distribution networks. The proposed algorithm combines the behavioral approach with the DistFlow model and leverages offline historical data to solve power flow problems using only a limited set of real-time measurements. To design DDPF under sparse measurement conditions, we develop a sensor placement problem based on optimal network reductions. This allows us to determine sensor locations subject to a predefined sensor budget and to explicitly account for the radial nature of distribution networks. Unlike approaches that rely on full observability, the proposed framework is designed for practical distribution grids with sparse measurement availability. This enables data-driven power flow for real-time operation while reducing the number of required sensors. On several test cases, the proposed DDPF algorithm could demonstrate accurate voltage magnitude predictions, with a maximum error less than 0.001 p.u., with as little as 25% of total locations equipped with sensors.

Jens Püttschneider, Simon Heilig, Asja Fischer et al.

We propose a training formulation for ResNets reflecting an optimal control problem that is applicable for standard architectures and general loss functions. We suggest bridging both worlds via penalizing intermediate outputs of hidden states corresponding to stage cost terms in optimal control. For standard ResNets, we obtain intermediate outputs by propagating the state through the subsequent skip connections and the output layer. We demonstrate that our training dynamic biases the weights of the unnecessary deeper residual layers to vanish. This indicates the potential for a theory-grounded layer pruning strategy.

Timm Faulwasser, Arne-Jens Hempel, Stefan Streif

It is well-known that the training of Deep Neural Networks (DNN) can be formalized in the language of optimal control. In this context, this paper leverages classical turnpike properties of optimal control problems to attempt a quantifiable answer to the question of how many layers should be considered in a DNN. The underlying assumption is that the number of neurons per layer -- i.e., the width of the DNN -- is kept constant. Pursuing a different route than the classical analysis of approximation properties of sigmoidal functions, we prove explicit bounds on the required depths of DNNs based on asymptotic reachability assumptions and a dissipativity-inducing choice of the regularization terms in the training problem. Numerical results obtained for the two spiral task data set for classification indicate that the proposed estimates can provide non-conservative depth bounds.

Alexander Engelmann, Timm Faulwasser

This paper investigates the role of feasible initial guesses and large consensus-violation penalization in distributed optimization for Optimal Power Flow (OPF) problems. Specifically, we discuss the behavior of the Alternating Direction of Multipliers Method (ADMM). We show that in case of large consensus-violation penalization ADMM might exhibit slow progress. We support this observation by an analysis of the algorithmic properties of ADMM. Furthermore, we illustrate our findings considering the IEEE 57 bus system and we draw upon a comparison of ADMM and the Augmented Lagrangian Alternating Direction Inexact Newton (ALADIN) method.

Timm Faulwasser, Milan Korda, Colin N. Jones et al.

This paper investigates the relations between three different properties, which are of importance in optimal control problems: dissipativity of the underlying dynamics with respect to a specific supply rate, optimal operation at steady state, and the turnpike property. We show in a continuous-time setting that if along optimal trajectories a strict dissipation inequality is satisfied, then this implies optimal operation at this steady state and the existence of a turnpike at the same steady state. Finally, we establish novel converse turnpike results, i.e., we show that the existence of a turnpike at a steady state implies optimal operation at this steady state and dissipativity with respect to this steady state. We draw upon a numerical example to illustrate our findings.

Timm Faulwasser, Tobias Weber, Juan Pablo Zometa et al.

Many robotic applications, such as milling, gluing, or high precision measurements, require the exact following of a pre-defined geometric path. In this paper, we investigate the real-time feasible implementation of model predictive path-following control for an industrial robot. We consider constrained output path following with and without reference speed assignment. We present results from an implementation of the proposed model predictive path-following controller on a KUKA LWR IV robot.