Giancarlo Ferrari‐Trecate

SY
h-index44
35papers
925citations
Novelty48%
AI Score53

35 Papers

1.2SYOct 3, 2014
Plug-and-play voltage and frequency control of islanded microgrids with meshed topology

Stefano Riverso, Fabio Sarzo, Giancarlo Ferrari-Trecate

In this paper we propose a new decentralized control scheme for Islanded microGrids (ImGs) composed by the interconnection of Distributed Generation Units (DGUs). Local controllers regulate voltage and frequency at the Point of Common Coupling (PCC) of each DGU and they are able to guarantee stability of the overall ImG. The control design procedure is decentralized, since, besides two global scalar quantities, the synthesis of a local controller uses only information on the corresponding DGU and lines connected to it. Most important, our design procedure enables Plug-and-Play (PnP) operations: when a DGU is plugged in or out, only DGUs physically connected to it have to retune their local controllers. We study the performance of the proposed controllers simulating different scenarios in MatLab/Simulink and using performance indexes proposed in IEEE standards.

5.1SYNov 6, 2023Code
Stable Linear Subspace Identification: A Machine Learning Approach

Loris Di Natale, Muhammad Zakwan, Bratislav Svetozarevic et al.

Machine Learning (ML) and linear System Identification (SI) have been historically developed independently. In this paper, we leverage well-established ML tools - especially the automatic differentiation framework - to introduce SIMBa, a family of discrete linear multi-step-ahead state-space SI methods using backpropagation. SIMBa relies on a novel Linear-Matrix-Inequality-based free parametrization of Schur matrices to ensure the stability of the identified model. We show how SIMBa generally outperforms traditional linear state-space SI methods, and sometimes significantly, although at the price of a higher computational burden. This performance gap is particularly remarkable compared to other SI methods with stability guarantees, where the gain is frequently above 25% in our investigations, hinting at SIMBa's ability to simultaneously achieve state-of-the-art fitting performance and enforce stability. Interestingly, these observations hold for a wide variety of input-output systems and on both simulated and real-world data, showcasing the flexibility of the proposed approach. We postulate that this new SI paradigm presents a great extension potential to identify structured nonlinear models from data, and we hence open-source SIMBa on https://github.com/Cemempamoi/simba.

7.3SYDec 20, 2013
Plug-and-Play Model Predictive Control based on robust control invariant sets

Stefano Riverso, Marcello Farina, Giancarlo Ferrari-Trecate

In this paper we consider a linear system represented by a coupling graph between subsystems and propose a distributed control scheme capable to guarantee asymptotic stability and satisfaction of constraints on system inputs and states. Most importantly, as in Riverso et al., 2012 our design procedure enables plug-and-play (PnP) operations, meaning that (i) the addition or removal of subsystems triggers the design of local controllers associated to successors to the subsystem only and (ii) the synthesis of a local controller for a subsystem requires information only from predecessors of the subsystem and it can be performed using only local computational resources. Our method hinges on local tube MPC controllers based on robust control invariant sets and it advances the PnP design procedure proposed in Riverso et al., 2012 in several directions. Quite notably, using recent results in the computation of robust control invariant sets, we show how critical steps in the design of a local controller can be solved through linear programming. Finally, an application of the proposed control design procedure to frequency control in power networks is presented.

1.2SYSep 18, 2014
Plug-and-play fault diagnosis and control-reconfiguration for a class of nonlinear large-scale constrained systems

Stefano Riverso, Francesca Boem, Giancarlo Ferrari-Trecate et al.

This paper deals with a novel Plug-and-Play (PnP) architecture for the control and monitoring of Large-Scale Systems (LSSs). The proposed approach integrates a distributed Model Predictive Control (MPC) strategy with a distributed Fault Detection (FD) architecture and methodology in a PnP framework. The basic concept is to use the FD scheme as an autonomous decision support system: once a fault is detected, the faulty subsystem can be unplugged to avoid the propagation of the fault in the interconnected LSS. Analogously, once the issue has been solved, the disconnected subsystem can be re-plugged-in. PnP design of local controllers and detectors allow these operations to be performed safely, i.e. without spoiling stability and constraint satisfaction for the whole LSS. The PnP distributed MPC is derived for a class of nonlinear LSS and an integrated PnP distributed FD architecture is proposed. Simulation results show the effectiveness and the potential of the general methodology.

2.3SYNov 18, 2017
A consensus-based secondary control layer for stable current sharing and voltage balancing in DC microgrids

Michele Tucci, Lexuan Meng, Josep M. Guerrero et al.

In this paper, we propose a secondary consensus-based control layer for current sharing and voltage balancing in DC microGrids (mGs). To this purpose, we assume that Distributed Generation Units (DGUs) are equipped with decentralized primary controllers guaranteeing voltage stability. This goal can be achieved using, for instance, Plug-and-Play (PnP) regulators. We analyze the behavior of the closed-loop mG by approximating local primary control loops with either unitary gains or first-order transfer functions. Besides proving exponential stability, current sharing, and voltage balancing, we describe how to design secondary controllers in a PnP fashion when DGUs are added or removed. Theoretical results are complemented by simulations, using a 7-DGUs mG implemented in Simulink/PLECS, and experiments on a 3-DGUs mG.

1.2SYMay 2, 2018
Distributed watermarking for secure control of microgrids under replay attacks

Alexander J. Gallo, Mustafa S. Turan, Francesca Boem et al.

The problem of replay attacks in the communication network between Distributed Generation Units (DGUs) of a DC microgrid is examined. The DGUs are regulated through a hierarchical control architecture, and are networked to achieve secondary control objectives. Following analysis of the detectability of replay attacks by a distributed monitoring scheme previously proposed, the need for a watermarking signal is identified. Hence, conditions are given on the watermark in order to guarantee detection of replay attacks, and such a signal is designed. Simulations are then presented to demonstrate the effectiveness of the technique.

1.2SYMar 29, 2017
Plug-and-play and coordinated control for bus-connected AC islanded microgrids

Stefano Riverso, Michele Tucci, Juan C. Vasquez et al.

This paper presents a distributed control architecture for voltage and frequency stabilization in AC islanded microgrids. In the primary control layer, each generation unit is equipped with a local controller acting on the corresponding voltage-source converter. Following the plug-and-play design approach previously proposed by some of the authors, whenever the addition/removal of a distributed generation unit is required, feasibility of the operation is automatically checked by designing local controllers through convex optimization. The update of the voltage-control layer, when units plug -in/-out, is therefore automatized and stability of the microgrid is always preserved. Moreover, local control design is based only on the knowledge of parameters of power lines and it does not require to store a global microgrid model. In this work, we focus on bus-connected microgrid topologies and enhance the primary plug-and-play layer with local virtual impedance loops and secondary coordinated controllers ensuring bus voltage tracking and reactive power sharing. In particular, the secondary control architecture is distributed, hence mirroring the modularity of the primary control layer. We validate primary and secondary controllers by performing experiments with balanced, unbalanced and nonlinear loads, on a setup composed of three bus-connected distributed generation units. Most importantly, the stability of the microgrid after the addition/removal of distributed generation units is assessed. Overall, the experimental results show the feasibility of the proposed modular control design framework, where generation units can be added/removed on the fly, thus enabling the deployment of virtual power plants that can be resized over time.

3.3SYJul 9, 2012
Hycon2 Benchmark: Power Network System

S. Riverso, G. Ferrari-Trecate

As a benchmark exercise for testing software and methods developed in Hycon2 for decentralized and distributed control, we address the problem of designing the Automatic Generation Control (AGC) layer in power network systems. In particular, we present three different scenarios and discuss performance levels that can be reached using Centralized Model Predictive Control (MPC). These results can be used as a milestone for comparing the performance of alternative control schemes. Matlab software for simulating the scenarios is also provided in an accompanying file.

1.2SYNov 14, 2022Code
Follow the Clairvoyant: an Imitation Learning Approach to Optimal Control

Andrea Martin, Luca Furieri, Florian Dörfler et al.

We consider control of dynamical systems through the lens of competitive analysis. Most prior work in this area focuses on minimizing regret, that is, the loss relative to an ideal clairvoyant policy that has noncausal access to past, present, and future disturbances. Motivated by the observation that the optimal cost only provides coarse information about the ideal closed-loop behavior, we instead propose directly minimizing the tracking error relative to the optimal trajectories in hindsight, i.e., imitating the clairvoyant policy. By embracing a system level perspective, we present an efficient optimization-based approach for computing follow-the-clairvoyant (FTC) safe controllers. We prove that these attain minimal regret if no constraints are imposed on the noncausal benchmark. In addition, we present numerical experiments to show that our policy retains the hallmark of competitive algorithms of interpolating between classical $\mathcal{H}_2$ and $\mathcal{H}_\infty$ control laws - while consistently outperforming regret minimization methods in constrained scenarios thanks to the superior ability to chase the clairvoyant.

14.6LGMar 22, 2022Code
Robust Classification using Contractive Hamiltonian Neural ODEs

Muhammad Zakwan, Liang Xu, Giancarlo Ferrari-Trecate

Deep neural networks can be fragile and sensitive to small input perturbations that might cause a significant change in the output. In this paper, we employ contraction theory to improve the robustness of neural ODEs (NODEs). A dynamical system is contractive if all solutions with different initial conditions converge to each other exponentially fast. As a consequence, perturbations in initial conditions become less and less relevant over time. Since in NODEs the input data corresponds to the initial condition of dynamical systems, we show contractivity can mitigate the effect of input perturbations. More precisely, inspired by NODEs with Hamiltonian dynamics, we propose a class of contractive Hamiltonian NODEs (CH-NODEs). By properly tuning a scalar parameter, CH-NODEs ensure contractivity by design and can be trained using standard backpropagation. Moreover, CH-NODEs enjoy built-in guarantees of non-exploding gradients, which ensure a well-posed training process. Finally, we demonstrate the robustness of CH-NODEs on the MNIST image classification problem with noisy test data.

2.3SYFeb 1, 2013
Plug-and-Play Decentralized Model Predictive Control

Stefano Riverso, Marcello Farina, Giancarlo Ferrari-Trecate

In this paper we consider a linear system structured into physically coupled subsystems and propose a decentralized control scheme capable to guarantee asymptotic stability and satisfaction of constraints on system inputs and states. The design procedure is totally decentralized, since the synthesis of a local controller uses only information on a subsystem and its neighbors, i.e. subsystems coupled to it. We first derive tests for checking if a subsystem can be plugged into (or unplugged from) an existing plant without spoiling overall stability and constraint satisfaction. When this is possible, we show how to automatize the design of local controllers so that it can be carried out in parallel by smart actuators equipped with computational resources and capable to exchange information with neighboring subsystems. In particular, local controllers exploit tube-based Model Predictive Control (MPC) in order to guarantee robustness with respect to physical coupling among subsystems. Finally, an application of the proposed control design procedure to frequency control in power networks is presented.

10.3SYMar 22, 2022Code
Neural System Level Synthesis: Learning over All Stabilizing Policies for Nonlinear Systems

Luca Furieri, Clara Lucía Galimberti, Giancarlo Ferrari-Trecate

We address the problem of designing stabilizing control policies for nonlinear systems in discrete-time, while minimizing an arbitrary cost function. When the system is linear and the cost is convex, the System Level Synthesis (SLS) approach offers an effective solution based on convex programming. Beyond this case, a globally optimal solution cannot be found in a tractable way, in general. In this paper, we develop a parametrization of all and only the control policies stabilizing a given time-varying nonlinear system in terms of the combined effect of 1) a strongly stabilizing base controller and 2) a stable SLS operator to be freely designed. Based on this result, we propose a Neural SLS (Neur-SLS) approach guaranteeing closed-loop stability during and after parameter optimization, without requiring any constraints to be satisfied. We exploit recent Deep Neural Network (DNN) models based on Recurrent Equilibrium Networks (RENs) to learn over a rich class of nonlinear stable operators, and demonstrate the effectiveness of the proposed approach in numerical examples.

8.6SYApr 6, 2023Code
Unconstrained Parametrization of Dissipative and Contracting Neural Ordinary Differential Equations

Daniele Martinelli, Clara Lucía Galimberti, Ian R. Manchester et al.

In this work, we introduce and study a class of Deep Neural Networks (DNNs) in continuous-time. The proposed architecture stems from the combination of Neural Ordinary Differential Equations (Neural ODEs) with the model structure of recently introduced Recurrent Equilibrium Networks (RENs). We show how to endow our proposed NodeRENs with contractivity and dissipativity -- crucial properties for robust learning and control. Most importantly, as for RENs, we derive parametrizations of contractive and dissipative NodeRENs which are unconstrained, hence enabling their learning for a large number of parameters. We validate the properties of NodeRENs, including the possibility of handling irregularly sampled data, in a case study in nonlinear system identification.

5.8LGNov 11, 2022
Physically Consistent Neural ODEs for Learning Multi-Physics Systems

Muhammad Zakwan, Loris Di Natale, Bratislav Svetozarevic et al.

Despite the immense success of neural networks in modeling system dynamics from data, they often remain physics-agnostic black boxes. In the particular case of physical systems, they might consequently make physically inconsistent predictions, which makes them unreliable in practice. In this paper, we leverage the framework of Irreversible port-Hamiltonian Systems (IPHS), which can describe most multi-physics systems, and rely on Neural Ordinary Differential Equations (NODEs) to learn their parameters from data. Since IPHS models are consistent with the first and second principles of thermodynamics by design, so are the proposed Physically Consistent NODEs (PC-NODEs). Furthermore, the NODE training procedure allows us to seamlessly incorporate prior knowledge of the system properties in the learned dynamics. We demonstrate the effectiveness of the proposed method by learning the thermodynamics of a building from the real-world measurements and the dynamics of a simulated gas-piston system. Thanks to the modularity and flexibility of the IPHS framework, PC-NODEs can be extended to learn physically consistent models of multi-physics distributed systems.

1.2SYMar 31, 2016
Kron reduction methods for plug-and-play control of ac islanded microgrids with arbitrary topology

Michele Tucci, Alessandro Floriduz, Stefano Riverso et al.

In this paper, we provide an extension of the scalable algorithm proposed in (Riverso et al., 2015) for the design of Plug-and-Play (PnP) controllers for AC Islanded microGrids (ImGs). The method in (Riverso et al., 2015) assumes DGUs are arranged in a load-connected topology, i.e. loads can appear only at the output terminals of inverters. For handling totally general interconnections of DGUs and loads, we describe an approach based on Kron Reduction (KR), a network reduction method giving an equivalent load-connected model of the original ImG. However, existing KR approaches can fail in preserving the structure of transfer functions representing transmission lines. To avoid this drawback, we introduce an approximate KR algorithm, still capable to represent exactly the asymptotic periodic behavior of electric signals even if they are unbalanced. Our results are backed up with simulations illustrating features of the new KR approach as well as its use for designing PnP controllers in a 21-bus ImG derived from an IEEE test feeder.

1.2SYApr 24, 2017
Voltage stabilization in DC microgrids: an approach based on line-independent plug-and-play controllers

Michele Tucci, Stefano Riverso, Giancarlo Ferrari-Trecate

We consider the problem of stabilizing voltages in DC microGrids (mGs) given by the interconnection of Distributed Generation Units (DGUs), power lines and loads. We propose a decentralized control architecture where the primary controller of each DGU can be designed in a Plug-and-Play (PnP) fashion, allowing the seamless addition of new DGUs. Differently from several other approaches to primary control, local design is independent of the parameters of power lines. Moreover, differently from the PnP control scheme in [1], the plug-in of a DGU does not require to update controllers of neighboring DGUs. Local control design is cast into a Linear Matrix Inequality (LMI) problem that, if unfeasible, allows one to deny plug-in requests that might be dangerous for mG stability. The proof of closed-loop stability of voltages exploits structured Lyapunov functions, the LaSalle invariance theorem and properties of graph Laplacians. Theoretical results are backed up by simulations in PSCAD.

6.8SYMar 26
On the Global Optimality of Linear Policies for Sinkhorn Distributionally Robust Linear Quadratic Control

Riccardo Cescon, Andrea Martin, Giancarlo Ferrari-Trecate

The Linear Quadratic Gaussian (LQG) regulator is a cornerstone of optimal control theory, yet its performance can degrade significantly when the noise distributions deviate from the assumed Gaussian model. To address this limitation, this work proposes a distributionally robust generalization of the finite-horizon LQG control problem. Specifically, we assume that the noise distributions are unknown and belong to ambiguity sets defined in terms of an entropy-regularized Wasserstein distance centered at a nominal Gaussian distribution. By deriving novel bounds on this Sinkhorn discrepancy and proving structural and topological properties of the resulting ambiguity sets, we establish global optimality of linear policies. Numerical experiments showcase improved distributional robustness of our control policy.

7.6SYMay 14
System Identification for Dynamic Modeling of Large Steering Angle Vehicles

Tobias Petri, Simone Baratto, Giancarlo Ferrari Trecate

This paper presents the modeling of autonomous vehicles with high maneuverability used in an experimental framework for educational purposes. Since standard bicycle models typically neglect wide steering angles, we develop modified planar bicycle models and combine them with both parametric and non-parametric identification techniques that progressively incorporate physical knowledge. The resulting models are systematically compared to evaluate the tradeoff between model accuracy and computational requirements, showing that physics-informed neural network models surpass the purely physical baseline in accuracy at lower computational cost.

7.3SYMar 26
Learning stabilising policies for constrained nonlinear systems

Daniele Ravasio, Danilo Saccani, Marcello Farina et al.

This work proposes a two-layered control scheme for constrained nonlinear systems represented by a class of recurrent neural networks and affected by additive disturbances. In particular, a base controller ensures global or regional closed-loop l_p-stability of the error in tracking a desired equilibrium and the satisfaction of input and output constraints within a robustly positive invariant set. An additional control contribution, derived by combining the internal model control principle with a stable operator, is introduced to improve system performance. This operator, implemented as a stable neural network, can be trained via unconstrained optimisation on a chosen performance metric, without compromising closed-loop equilibrium tracking or constraint satisfaction, even if the optimisation is stopped prematurely. In addition, we characterise the class of closed-loop stable behaviours that can be achieved with the proposed architecture. Simulation results on a pH-neutralisation benchmark demonstrate the effectiveness of the proposed approach.

5.3LGMar 21, 2023
Universal Approximation Property of Hamiltonian Deep Neural Networks

Muhammad Zakwan, Massimiliano d'Angelo, Giancarlo Ferrari-Trecate

This paper investigates the universal approximation capabilities of Hamiltonian Deep Neural Networks (HDNNs) that arise from the discretization of Hamiltonian Neural Ordinary Differential Equations. Recently, it has been shown that HDNNs enjoy, by design, non-vanishing gradients, which provide numerical stability during training. However, although HDNNs have demonstrated state-of-the-art performance in several applications, a comprehensive study to quantify their expressivity is missing. In this regard, we provide a universal approximation theorem for HDNNs and prove that a portion of the flow of HDNNs can approximate arbitrary well any continuous function over a compact domain. This result provides a solid theoretical foundation for the practical use of HDNNs.

3.1MLSep 5, 2024
Maximum likelihood inference for high-dimensional problems with multiaffine variable relations

Jean-Sébastien Brouillon, Florian Dörfler, Giancarlo Ferrari-Trecate

Maximum Likelihood Estimation of continuous variable models can be very challenging in high dimensions, due to potentially complex probability distributions. The existence of multiple interdependencies among variables can make it very difficult to establish convergence guarantees. This leads to a wide use of brute-force methods, such as grid searching and Monte-Carlo sampling and, when applicable, complex and problem-specific algorithms. In this paper, we consider inference problems where the variables are related by multiaffine expressions. We propose a novel Alternating and Iteratively-Reweighted Least Squares (AIRLS) algorithm, and prove its convergence for problems with Generalized Normal Distributions. We also provide an efficient method to compute the variance of the estimates obtained using AIRLS. Finally, we show how the method can be applied to graphical statistical models. We perform numerical experiments on several inference problems, showing significantly better performance than state-of-the-art approaches in terms of scalability, robustness to noise, and convergence speed due to an empirically observed super-linear convergence rate.

8.6SYMay 1, 2024Code
Learning to Boost the Performance of Stable Nonlinear Systems

Luca Furieri, Clara Lucía Galimberti, Giancarlo Ferrari-Trecate

The growing scale and complexity of safety-critical control systems underscore the need to evolve current control architectures aiming for the unparalleled performances achievable through state-of-the-art optimization and machine learning algorithms. However, maintaining closed-loop stability while boosting the performance of nonlinear control systems using data-driven and deep-learning approaches stands as an important unsolved challenge. In this paper, we tackle the performance-boosting problem with closed-loop stability guarantees. Specifically, we establish a synergy between the Internal Model Control (IMC) principle for nonlinear systems and state-of-the-art unconstrained optimization approaches for learning stable dynamics. Our methods enable learning over arbitrarily deep neural network classes of performance-boosting controllers for stable nonlinear systems; crucially, we guarantee L_p closed-loop stability even if optimization is halted prematurely, and even when the ground-truth dynamics are unknown, with vanishing conservatism in the class of stabilizing policies as the model uncertainty is reduced to zero. We discuss the implementation details of the proposed control schemes, including distributed ones, along with the corresponding optimization procedures, demonstrating the potential of freely shaping the cost functions through several numerical experiments.

5.1SYNov 15, 2024
Neural Port-Hamiltonian Models for Nonlinear Distributed Control: An Unconstrained Parametrization Approach

Muhammad Zakwan, Giancarlo Ferrari-Trecate

The control of large-scale cyber-physical systems requires optimal distributed policies relying solely on limited communication with neighboring agents. However, computing stabilizing controllers for nonlinear systems while optimizing complex costs remains a significant challenge. Neural Networks (NNs), known for their expressivity, can be leveraged to parametrize control policies that yield good performance. However, NNs' sensitivity to small input changes poses a risk of destabilizing the closed-loop system. Many existing approaches enforce constraints on the controllers' parameter space to guarantee closed-loop stability, leading to computationally expensive optimization procedures. To address these problems, we leverage the framework of port-Hamiltonian systems to design continuous-time distributed control policies for nonlinear systems that guarantee closed-loop stability and finite $\mathcal{L}_2$ or incremental $\mathcal{L}_2$ gains, independent of the optimzation parameters of the controllers. This eliminates the need to constrain parameters during optimization, allowing the use of standard techniques such as gradient-based methods. Additionally, we discuss discretization schemes that preserve the dissipation properties of these controllers for implementation on embedded systems. The effectiveness of the proposed distributed controllers is demonstrated through consensus control of non-holonomic mobile robots subject to collision avoidance and averaged voltage regulation with weighted power sharing in DC microgrids.

7.9LGDec 10, 2024Code
Contractive Dynamical Imitation Policies for Efficient Out-of-Sample Recovery

Amin Abyaneh, Mahrokh G. Boroujeni, Hsiu-Chin Lin et al.

Imitation learning is a data-driven approach to learning policies from expert behavior, but it is prone to unreliable outcomes in out-of-sample (OOS) regions. While previous research relying on stable dynamical systems guarantees convergence to a desired state, it often overlooks transient behavior. We propose a framework for learning policies modeled by contractive dynamical systems, ensuring that all policy rollouts converge regardless of perturbations, and in turn, enable efficient OOS recovery. By leveraging recurrent equilibrium networks and coupling layers, the policy structure guarantees contractivity for any parameter choice, which facilitates unconstrained optimization. We also provide theoretical upper bounds for worst-case and expected loss to rigorously establish the reliability of our method in deployment. Empirically, we demonstrate substantial OOS performance improvements for simulated robotic manipulation and navigation tasks.

5.1SYApr 3, 2025Code
MAD: A Magnitude And Direction Policy Parametrization for Stability Constrained Reinforcement Learning

Luca Furieri, Sucheth Shenoy, Danilo Saccani et al.

We introduce magnitude and direction (MAD) policies, a policy parameterization for reinforcement learning (RL) that preserves Lp closed-loop stability for nonlinear dynamical systems. Despite their completeness in describing all stabilizing controllers, methods based on nonlinear Youla and system-level synthesis are significantly impacted by the difficulty of parametrizing Lp-stable operators. In contrast, MAD policies introduce explicit feedback on state-dependent features - a key element behind the success of reinforcement learning pipelines - without jeopardizing closed-loop stability. This is achieved by letting the magnitude of the control input be described by a disturbance-feedback Lp-stable operator, while selecting its direction based on state-dependent features through a universal function approximator. We further characterize the robust stability properties of MAD policies under model mismatch. Unlike existing disturbance-feedback policy parametrizations, MAD policies introduce state-feedback components compatible with model-free RL pipelines, ensuring closed-loop stability with no model information beyond assuming open-loop stability. Numerical experiments show that MAD policies trained with deep deterministic policy gradient (DDPG) methods generalize to unseen scenarios - matching the performance of standard neural network policies while guaranteeing closed-loop stability by design.

3.3SYMar 31, 2025Code
Free Parametrization of L2-bounded State Space Models

Leonardo Massai, Giancarlo Ferrari-Trecate

Structured state-space models (SSMs) have emerged as a powerful architecture in machine learning and control, featuring stacked layers where each consists of a linear time-invariant (LTI) discrete-time system followed by a nonlinearity. While SSMs offer computational efficiency and excel in long-sequence predictions, their widespread adoption in applications like system identification and optimal control is hindered by the challenge of ensuring their stability and robustness properties. We introduce L2RU, a novel parametrization of SSMs that guarantees input-output stability and robustness by enforcing a prescribed L-bound for all parameter values. This design eliminates the need for complex constraints, allowing unconstrained optimization over L2RUs by using standard methods such as gradient descent. Leveraging tools from system theory and convex optimization, we derive a non-conservative parametrization of square discrete-time LTI systems with a specified L2-bound, forming the foundation of the L2RU architecture. Additionally, we enhance its performance with a bespoke initialization strategy optimized for long input sequences. Through a system identification task, we validate L2RU's superior performance, showcasing its potential in learning and control applications.

10.4LGJan 16, 2024
Personalized Federated Learning of Probabilistic Models: A PAC-Bayesian Approach

Mahrokh Ghoddousi Boroujeni, Andreas Krause, Giancarlo Ferrari Trecate

Federated Learning (FL) aims to infer a shared model from private and decentralized data stored by multiple clients. Personalized FL (PFL) enhances the model's fit for each client by adapting the global model to the clients. A significant level of personalization is required for highly heterogeneous clients but can be challenging to achieve, especially when clients' datasets are small. To address this issue, we introduce the PAC-PFL framework for PFL of probabilistic models. PAC-PFL infers a shared hyper-posterior and treats each client's posterior inference as the personalization step. Unlike previous PFL algorithms, PAC-PFL does not regularize all personalized models towards a single shared model, thereby greatly enhancing its personalization flexibility. By establishing and minimizing a PAC-Bayesian generalization bound on the average true loss of clients, PAC-PFL effectively mitigates overfitting even in data-poor scenarios. Additionally, PAC-PFL provides generalization bounds for new clients joining later. PAC-PFL achieves accurate and well-calibrated predictions, as supported by our experiments.

9.7SYDec 16, 2021Code
Distributed neural network control with dependability guarantees: a compositional port-Hamiltonian approach

Luca Furieri, Clara Lucía Galimberti, Muhammad Zakwan et al.

Large-scale cyber-physical systems require that control policies are distributed, that is, that they only rely on local real-time measurements and communication with neighboring agents. Optimal Distributed Control (ODC) problems are, however, highly intractable even in seemingly simple cases. Recent work has thus proposed training Neural Network (NN) distributed controllers. A main challenge of NN controllers is that they are not dependable during and after training, that is, the closed-loop system may be unstable, and the training may fail due to vanishing and exploding gradients. In this paper, we address these issues for networks of nonlinear port-Hamiltonian (pH) systems, whose modeling power ranges from energy systems to non-holonomic vehicles and chemical reactions. Specifically, we embrace the compositional properties of pH systems to characterize deep Hamiltonian control policies with built-in closed-loop stability guarantees, irrespective of the interconnection topology and the chosen NN parameters. Furthermore, our setup enables leveraging recent results on well-behaved neural ODEs to prevent the phenomenon of vanishing gradients by design. Numerical experiments corroborate the dependability of the proposed architecture, while matching the performance of general neural network policies.

3.3SYJul 9, 2021
Bayesian Error-in-Variables Models for the Identification of Power Networks

Jean-Sébastien Brouillon, Emanuele Fabbiani, Pulkit Nahata et al.

The increasing integration of intermittent renewable generation, especially at the distribution level,necessitates advanced planning and optimisation methodologies contingent on the knowledge of thegrid, specifically the admittance matrix capturing the topology and line parameters of an electricnetwork. However, a reliable estimate of the admittance matrix may either be missing or quicklybecome obsolete for temporally varying grids. In this work, we propose a data-driven identificationmethod utilising voltage and current measurements collected from micro-PMUs. More precisely,we first present a maximum likelihood approach and then move towards a Bayesian framework,leveraging the principles of maximum a posteriori estimation. In contrast with most existing con-tributions, our approach not only factors in measurement noise on both voltage and current data,but is also capable of exploiting available a priori information such as sparsity patterns and knownline parameters. Simulations conducted on benchmark cases demonstrate that, compared to otheralgorithms, our method can achieve significantly greater accuracy.

11.9LGMay 27, 2021Code
Hamiltonian Deep Neural Networks Guaranteeing Non-vanishing Gradients by Design

Clara Lucía Galimberti, Luca Furieri, Liang Xu et al.

Deep Neural Networks (DNNs) training can be difficult due to vanishing and exploding gradients during weight optimization through backpropagation. To address this problem, we propose a general class of Hamiltonian DNNs (H-DNNs) that stem from the discretization of continuous-time Hamiltonian systems and include several existing DNN architectures based on ordinary differential equations. Our main result is that a broad set of H-DNNs ensures non-vanishing gradients by design for an arbitrary network depth. This is obtained by proving that, using a semi-implicit Euler discretization scheme, the backward sensitivity matrices involved in gradient computations are symplectic. We also provide an upper-bound to the magnitude of sensitivity matrices and show that exploding gradients can be controlled through regularization. Finally, we enable distributed implementations of backward and forward propagation algorithms in H-DNNs by characterizing appropriate sparsity constraints on the weight matrices. The good performance of H-DNNs is demonstrated on benchmark classification problems, including image classification with the MNIST dataset.

4.4LGApr 27, 2021
A unified framework for Hamiltonian deep neural networks

Clara L. Galimberti, Liang Xu, Giancarlo Ferrari Trecate

Training deep neural networks (DNNs) can be difficult due to the occurrence of vanishing/exploding gradients during weight optimization. To avoid this problem, we propose a class of DNNs stemming from the time discretization of Hamiltonian systems. The time-invariant version of the corresponding Hamiltonian models enjoys marginal stability, a property that, as shown in previous works and for specific DNNs architectures, can mitigate convergence to zero or divergence of gradients. In the present paper, we formally study this feature by deriving and analysing the backward gradient dynamics in continuous time. The proposed Hamiltonian framework, besides encompassing existing networks inspired by marginally stable ODEs, allows one to derive new and more expressive architectures. The good performance of the novel DNNs is demonstrated on benchmark classification problems, including digit recognition using the MNIST dataset.

3.3SYMar 13, 2020
Identification of AC Networks via Online Learning

Emanuele Fabbiani, Pulkit Nahata, Giuseppe De Nicolao et al.

The increasing penetration of intermittent distributed energy resources in power networks calls for novel planning and control methodologies which hinge on detailed knowledge of the grid. However, reliable information concerning the system topology and parameters may be missing or outdated for temporally varying electric distribution networks. This paper proposes an online learning procedure to estimate the network admittance matrix capturing topological information and line parameters. We start off by providing a recursive identification algorithm exploiting phasor measurements of voltages and currents. With the goal of accelerating convergence, we subsequently complement our base algorithm with a design-of-experiment procedure which maximizes the information content of data at each step by computing optimal voltage excitations. Our approach improves on existing techniques, and its effectiveness is substantiated by numerical studies on realistic testbeds.

1.2SYOct 15, 2018
A scalable line-independent design algorithm for voltage and frequency control in AC islanded microgrids

Michele Tucci, Giancarlo Ferrari Trecate

We propose a decentralized control synthesis procedure for stabilizing voltage and frequency in AC Islanded microGrids (ImGs) composed of Distributed Generation Units (DGUs) and loads interconnected through power lines. The presented approach enables Plug-and-Play (PnP) operations, meaning that DGUs can be added or removed without compromising the overall ImG stability. The main feature of our approach is that the proposed design algorithm is line-independent. This implies that (i) the synthesis of each local controller requires only the parameters of the corresponding DGU and not the model of power lines connecting neighboring DGUs, and (ii) whenever a new DGU is plugged in, DGUs physically coupled with it do not have to retune their regulators because of the new power line connected to them. Moreover, we formally prove that stabilizing local controllers can be always computed, independently of the electrical parameters. Theoretical results are validated by simulating in PSCAD the behavior of a 10-DGUs ImG.

1.2SYMar 24, 2015
A decentralized scalable approach to voltage control of DC islanded microgrids

Michele Tucci, Stefano Riverso, Juan C. Vasquez et al.

We propose a new decentralized control scheme for DC Islanded microGrids (ImGs) composed by several Distributed Generation Units (DGUs) with a general interconnection topology. Each local controller regulates to a reference value the voltage of the Point of Common Coupling (PCC) of the corresponding DGU. Notably, off-line control design is conducted in a Plug-and-Play (PnP) fashion meaning that (i) the possibility of adding/removing a DGU without spoiling stability of the overall ImG is checked through an optimization problem; (ii) when a DGU is plugged in or out at most neighbouring DGUs have to update their controllers and (iii) the synthesis of a local controller uses only information on the corresponding DGU and lines connected to it. This guarantee total scalability of control synthesis as the ImG size grows or DGU gets replaced. Yes, under mild approximations of line dynamics, we formally guarantee stability of the overall closed-loop ImG. The performance of the proposed controllers is analyzed simulating different scenarios in PSCAD.

1.2SYMar 22, 2015
Model predictive controllers for reduction of mechanical fatigue in wind farms

Stefano Riverso, Simone Mancini, Fabio Sarzo et al.

We consider the problem of dispatching WindFarm (WF) power demand to individual Wind Turbines (WT) with the goal of minimizing mechanical stresses. We assume wind is strong enough to let each WTs to produce the required power and propose different closed-loop Model Predictive Control (MPC) dispatching algorithms. Similarly to existing approaches based on MPC, our methods do not require changes in WT hardware but only software changes in the SCADA system of the WF. However, differently from previous MPC schemes, we augment the model of a WT with an ARMA predictor of the wind turbulence, which reduces uncertainty in wind predictions over the MPC control horizon. This allows us to develop both stochastic and deterministic MPC algorithms. In order to compare different MPC schemes and demonstrate improvements with respect to classic open-loop schedulers, we performed simulations using the SimWindFarm toolbox for MatLab. We demonstrate that MPC controllers allow to achieve reduction of stresses even in the case of large installations such as the 100-WTs Thanet offshore WF.