SYMay 12, 2016
Constraint-Tightening and Stability in Stochastic Model Predictive ControlMatthias Lorenzen, Fabrizio Dabbene, Roberto Tempo et al.
Constraint tightening to non-conservatively guarantee recursive feasibility and stability in Stochastic Model Predictive Control is addressed. Stability and feasibility requirements are considered separately, highlighting the difference between existence of a solution and feasibility of a suitable, a priori known candidate solution. Subsequently, a Stochastic Model Predictive Control algorithm which unifies previous results is derived, leaving the designer the option to balance an increased feasible region against guaranteed bounds on the asymptotic average performance and convergence time. Besides typical performance bounds, under mild assumptions, we prove asymptotic stability in probability of the minimal robust positively invariant set obtained by the unconstrained LQ-optimal controller. A numerical example, demonstrating the efficacy of the proposed approach in comparison with classical, recursively feasible Stochastic MPC and Robust MPC, is provided.
SYJun 20, 2016
Stochastic MPC with Offline Uncertainty SamplingMatthias Lorenzen, Fabrizio Dabbene, Roberto Tempo et al.
For discrete-time linear systems subject to parametric uncertainty described by random variables, we develop a sampling-based Stochastic Model Predictive Control algorithm. Unlike earlier results employing a scenario approximation, we propose an offline sampling approach in the design phase instead of online scenario generation. The paper highlights the structural difference between online and offline sampling and provides rigorous bounds on the number of samples needed to guarantee chance constraint satisfaction. The approach does not only significantly speed up the online computation, but furthermore allows to suitably tighten the constraints to guarantee robust recursive feasibility when bounds on the uncertain variables are provided. Under mild assumptions, asymptotic stability of the origin can be established.
OCSep 29, 2014
An Improved Constraint-Tightening Approach for Stochastic MPCMatthias Lorenzen, Frank Allgöwer, Fabrizio Dabbene et al.
The problem of achieving a good trade-off in Stochastic Model Predictive Control between the competing goals of improving the average performance and reducing conservativeness, while still guaranteeing recursive feasibility and low computational complexity, is addressed. We propose a novel, less restrictive scheme which is based on considering stability and recursive feasibility separately. Through an explicit first step constraint we guarantee recursive feasibility. In particular we guarantee the existence of a feasible input trajectory at each time instant, but we only require that the input sequence computed at time $k$ remains feasible at time $k+1$ for most disturbances but not necessarily for all, which suffices for stability. To overcome the computational complexity of probabilistic constraints, we propose an offline constraint-tightening procedure, which can be efficiently solved via a sampling approach to the desired accuracy. The online computational complexity of the resulting Model Predictive Control (MPC) algorithm is similar to that of a nominal MPC with terminal region. A numerical example, which provides a comparison with classical, recursively feasible Stochastic MPC and Robust MPC, shows the efficacy of the proposed approach.
SYMar 8, 2018
An Offline-Sampling SMPC Framework with Application to Automated Space ManeuversMartina Mammarella, Matthias Lorenzen, Elisa Capello et al.
In this paper, a sampling-based Stochastic Model Predictive Control algorithm is proposed for discrete-time linear systems subject to both parametric uncertainties and additive disturbances. One of the main drivers for the development of the proposed control strategy is the need of real-time implementability of guidance and control strategies for automated rendezvous and proximity operations between spacecraft. The paper presents considers the validation of the proposed control algorithm on an experimental testbed, showing how it may indeed be implemented in a realistic framework. Parametric uncertainties due to the mass variations during operations, linearization errors, and disturbances due to external space environment are simultaneously considered. The approach enables to suitably tighten the constraints to guarantee robust recursive feasibility when bounds on the uncertain variables are provided, and under mild assumptions, asymptotic stability in probability of the origin can be established. The offline sampling approach in the control design phase is shown to reduce the computational cost, which usually constitutes the main limit for the adoption of Stochastic Model Predictive Control schemes, especially for low-cost on-board hardware. These characteristics are demonstrated both through simulations and by means of experimental results.
ITMar 5, 2013
Anytime Reliable LDPC Convolutional Codes for Networked Control over Wireless ChannelAlberto Tarable, Alessandro Nordio, Fabrizio Dabbene et al.
This paper deals with the problem of stabilizing an unstable system through networked control over the wireless medium. In such a situation a remote sensor communicates the measurements to the system controller through a noisy channel. In particular, in the AWGN scenario, we show that protograph-based LDPC convolutional codes achieve anytime reliability and we also derive a lower bound to the signal-to-noise ratio required to stabilize the system. Moreover, on the Rayleigh-fading channel, we show by simulations that resorting to multiple sensors allows to achieve a diversity gain.
SYJul 1, 2016
Robust linear static anti-windup with probabilistic certificatesSimone Formentin, Fabrizio Dabbene, Roberto Tempo et al.
In this paper, we address robust static anti-windup compensator design and performance analysis for saturated linear closed loops in the presence of nonlinear probabilistic parameter uncertainties via randomized techniques. The proposed static anti-windup analysis and robust performance synthesis correspond to several optimization goals, ranging from minimization of the nonlinear input/output gain to maximization of the stability region or maximization of the domain of attraction. We also introduce a novel paradigm accounting for uncertainties in the energy of the disturbance inputs. Due to the special structure of linear static anti-windup design, wherein the design variables are decoupled from the Lyapunov certificates, we introduce a significant extension, called scenario with certificates (SwC), of the so-called scenario approach for uncertain optimization problems. This extension is of independent interest for similar robust synthesis problems involving parameter-dependent Lyapunov functions. We demonstrate that the scenario with certificates robust design formulation is appealing because it provides a way to implicitly design the parameter-dependent Lyapunov functions and to remove restrictive assumptions about convexity with respect to the uncertain parameters. Subsequently, to reduce the computational cost, we present a sequential randomized algorithm for iteratively solving this problem. The obtained results are illustrated by numerical examples.
SYMar 25, 2019
Identification of Switched Autoregressive Systems from Large Noisy Data SetsSarah Hojjatinia, Constantino M. Lagoa, Fabrizio Dabbene
The paper introduces a novel methodology for the identification of coefficients of switched autoregressive linear models. We consider the case when the system's outputs are contaminated by possibly large values of measurement noise. It is assumed that only partial information on the probability distribution of the noise is available. Given input-output data, we aim at identifying switched system coefficients and parameters of the distribution of the noise which are compatible with the collected data. System dynamics are estimated through expected values computation and by exploiting the strong law of large numbers. We demonstrate the efficiency of the proposed approach with several academic examples. The method is shown to be extremely effective in the situations where a large number of measurements is available; cases in which previous approaches based on polynomial or mixed-integer optimization cannot be applied due to very large computational burden.
SYJun 5, 2013
Probabilistic Optimal Estimation and Filtering under UncertaintyFabrizio Dabbene, Mario Sznaier, Roberto Tempo
The classical approach to system identification is based on stochastic assumptions about the measurement error, and provides estimates that have random nature. Worst-case identification, on the other hand, only assumes the knowledge of deterministic error bounds, and establishes guaranteed estimates, thus being in principle better suited for the use in control design. However, a main limitation of such deterministic bounds lies on their potential conservatism, thus leading to estimates of restricted use. In this paper, we propose a rapprochement between the stochastic and worst-case paradigms. In particular, based on a probabilistic framework for linear estimation problems, we derive new computational results. These results combine elements from information-based complexity with recent developments in the theory of randomized algorithms. The main idea in this line of research is to "discard" sets of measure at most ε, where εis a probabilistic accuracy, from the set of deterministic estimates. Therefore, we are decreasing the so-called worst-case radius of information at the expense of a given probabilistic ``risk." In this setting, we compute a trade-off curve, called violation function, which shows how the radius of information decreases as a function of the accuracy. To this end, we construct randomized and deterministic algorithms which provide approximations of this function. We report extensive simulations showing numerical comparisons between the stochastic, worst-case and probabilistic approaches, thus demonstrating the efficacy of the methods proposed in this paper.
SYApr 19, 2018
Randomized opinion dynamics over networks: influence estimation from partial observationsChiara Ravazzi, Sarah Hojjatinia, Constantino M. Lagoa et al.
In this paper, we propose a technique for the estimation of the influence matrix in a sparse social network, in which $n$ individual communicate in a gossip way. At each step, a random subset of the social actors is active and interacts with randomly chosen neighbors. The opinions evolve according to a Friedkin and Johnsen mechanism, in which the individuals updates their belief to a convex combination of their current belief, the belief of the agents they interact with, and their initial belief, or prejudice. Leveraging recent results of estimation of vector autoregressive processes, we reconstruct the social network topology and the strength of the interconnections starting from \textit{partial observations} of the interactions, thus removing one of the main drawbacks of finite horizon techniques. The effectiveness of the proposed method is shown on randomly generation networks.
SINov 20, 2018
Learning Political DNA in the Italian SenateAntonio Longo, Chiara Ravazzi, Fabrizio Dabbene et al.
Motivated by the increasing interest of the control community towards social sciences and the study of opinion formation and belief systems, in this paper we address the problem of exploiting voting data for inferring the underlying affinity of individuals to competing ideology groups. In particular, we mine key voting records of the Italian Senate during the XVII legislature, in order to extract the hidden information about the closeness of senators to political parties, based on a parsimonious feature extraction method that selects the most relevant bills. Modeling the voting data as outcomes of a mixture of random variables and using sparse learning techniques, we cast the problem in a probabilistic framework and derive an information theoretic measure, which we refer to as Political Data-aNalytic Affinity (Political DNA). The advantages of this new affinity measure are discussed in the paper. The results of the numerical analysis on voting data unveil underlying relationships among political exponents of the Italian Senate.
SYOct 31, 2023
One-shot backpropagation for multi-step prediction in physics-based system identification -- EXTENDED VERSIONCesare Donati, Martina Mammarella, Fabrizio Dabbene et al.
The aim of this paper is to present a novel physics-based framework for the identification of dynamical systems, in which the physical and structural insights are reflected directly into a backpropagation-based learning algorithm. The main result is a method to compute in closed form the gradient of a multi-step loss function, while enforcing physical properties and constraints. The derived algorithm has been exploited to identify the unknown inertia matrix of a space debris, and the results show the reliability of the method in capturing the physical adherence of the estimated parameters.
OCMay 23, 2019
Algorithms for Optimal AC Power Flow in the Presence of Renewable SourcesMohammadreza Chamanbaz, Fabrizio Dabbene, Constantino Lagoa
This chapter presents recent solutions to the optimal power flow (OPF) problem in the presence of renewable energy sources (RES), {such} as solar photo-voltaic and wind generation. After introducing the original formulation of the problem, arising from the combination of economic dispatch and power flow, we provide a brief overview of the different solution methods proposed in the literature to solve it. Then, we explain the main difficulties arising from the increasing RES penetration, and the ensuing necessity of deriving robust solutions. Finally, we present the state-of-the-art techniques, with a special focus on recent methods we developed, based on the application on randomization-based methodologies.
SYMay 15, 2018
Sample-based SMPC for tracking control of fixed-wing UAV: multi-scenario mappingMartina Mammarella, Elisa Capello, Fabrizio Dabbene
In this paper, a guidance and tracking control strategy for fixed-wing Unmanned Aerial Vehicle (UAV) autopilots is presented. The proposed control exploits recent results on sample-based stochastic Model Predictive Control, which allow coping in a computationally efficient way with both parametric uncertainty and additive random noise. Different application scenarios are discussed, and the implementability of the proposed approach are demonstrated through software-in-the-loop simulations. The capability of guaranteeing probabilistic robust satisfaction of the constraint specifications represents a key-feature of the proposed scheme, allowing real-time tracking of the designed trajectory with guarantees in terms of maximal deviation with respect to the planned one. The presented simulations show the effectiveness of the proposed control scheme.
LGSep 4, 2023
CONFIDERAI: a novel CONFormal Interpretable-by-Design score function for Explainable and Reliable Artificial IntelligenceSara Narteni, Alberto Carlevaro, Fabrizio Dabbene et al.
Everyday life is increasingly influenced by artificial intelligence, and there is no question that machine learning algorithms must be designed to be reliable and trustworthy for everyone. Specifically, computer scientists consider an artificial intelligence system safe and trustworthy if it fulfills five pillars: explainability, robustness, transparency, fairness, and privacy. In addition to these five, we propose a sixth fundamental aspect: conformity, that is, the probabilistic assurance that the system will behave as the machine learner expects. In this paper, we present a methodology to link conformal prediction with explainable machine learning by defining a new score function for rule-based classifiers that leverages rules predictive ability, the geometrical position of points within rules boundaries and the overlaps among rules as well, thanks to the definition of a geometrical rule similarity term. Furthermore, we address the problem of defining regions in the feature space where conformal guarantees are satisfied, by exploiting the definition of conformal critical set and showing how this set can be used to achieve new rules with improved performance on the target class. The overall methodology is tested with promising results on several datasets of real-world interest, such as domain name server tunneling detection or cardiovascular disease prediction.
MLSep 8, 2023
Probabilistic Safety Regions Via Finite Families of Scalable ClassifiersAlberto Carlevaro, Teodoro Alamo, Fabrizio Dabbene et al.
Supervised classification recognizes patterns in the data to separate classes of behaviours. Canonical solutions contain misclassification errors that are intrinsic to the numerical approximating nature of machine learning. The data analyst may minimize the classification error on a class at the expense of increasing the error of the other classes. The error control of such a design phase is often done in a heuristic manner. In this context, it is key to develop theoretical foundations capable of providing probabilistic certifications to the obtained classifiers. In this perspective, we introduce the concept of probabilistic safety region to describe a subset of the input space in which the number of misclassified instances is probabilistically controlled. The notion of scalable classifiers is then exploited to link the tuning of machine learning with error control. Several tests corroborate the approach. They are provided through synthetic data in order to highlight all the steps involved, as well as through a smart mobility application.
MLJan 29, 2025Code
Exact characterization of ε-Safe Decision Regions for exponential family distributions and Multi Cost SVM approximationAlberto Carlevaro, Teodoro Alamo, Fabrizio Dabbene et al.
Probabilistic guarantees on the prediction of data-driven classifiers are necessary to define models that can be considered reliable. This is a key requirement for modern machine learning in which the goodness of a system is measured in terms of trustworthiness, clearly dividing what is safe from what is unsafe. The spirit of this paper is exactly in this direction. First, we introduce a formal definition of ε-Safe Decision Region, a subset of the input space in which the prediction of a target (safe) class is probabilistically guaranteed. Second, we prove that, when data come from exponential family distributions, the form of such a region is analytically determined and controllable by design parameters, i.e. the probability of sampling the target class and the confidence on the prediction. However, the request of having exponential data is not always possible. Inspired by this limitation, we developed Multi Cost SVM, an SVM based algorithm that approximates the safe region and is also able to handle unbalanced data. The research is complemented by experiments and code available for reproducibility.
MLMar 15, 2024
Conformal Predictions for Probabilistically Robust Scalable Machine Learning ClassificationAlberto Carlevaro, Teodoro Alamo Cantarero, Fabrizio Dabbene et al.
Conformal predictions make it possible to define reliable and robust learning algorithms. But they are essentially a method for evaluating whether an algorithm is good enough to be used in practice. To define a reliable learning framework for classification from the very beginning of its design, the concept of scalable classifier was introduced to generalize the concept of classical classifier by linking it to statistical order theory and probabilistic learning theory. In this paper, we analyze the similarities between scalable classifiers and conformal predictions by introducing a new definition of a score function and defining a special set of input variables, the conformal safety set, which can identify patterns in the input space that satisfy the error coverage guarantee, i.e., that the probability of observing the wrong (possibly unsafe) label for points belonging to this set is bounded by a predefined $\varepsilon$ error level. We demonstrate the practical implications of this framework through an application in cybersecurity for identifying DNS tunneling attacks. Our work contributes to the development of probabilistically robust and reliable machine learning models.
SYFeb 6, 2022
3D Map Reconstruction of an Orchard using an Angle-Aware Covering Control StrategyMartina Mammarella, Cesare Donati, Takumi Shimizu et al.
In the last years, unmanned aerial vehicles are becoming a reality in the context of precision agriculture, mainly for monitoring, patrolling and remote sensing tasks, but also for 3D map reconstruction. In this paper, we present an innovative approach where a fleet of unmanned aerial vehicles is exploited to perform remote sensing tasks over an apple orchard for reconstructing a 3D map of the field, formulating the covering control problem to combine the position of a monitoring target and the viewing angle. Moreover, the objective function of the controller is defined by an importance index, which has been computed from a multi-spectral map of the field, obtained by a preliminary flight, using a semantic interpretation scheme based on a convolutional neural network. This objective function is then updated according to the history of the past coverage states, thus allowing the drones to take situation-adaptive actions. The effectiveness of the proposed covering control strategy has been validated through simulations on a Robot Operating System.
SYMay 21, 2020
Computationally efficient stochastic MPC: a probabilistic scaling approachMartina Mammarella, Teodoro Alamo, Fabrizio Dabbene et al.
In recent years, the increasing interest in Stochastic model predictive control (SMPC) schemes has highlighted the limitation arising from their inherent computational demand, which has restricted their applicability to slow-dynamics and high-performing systems. To reduce the computational burden, in this paper we extend the probabilistic scaling approach to obtain low-complexity inner approximation of chance-constrained sets. This approach provides probabilistic guarantees at a lower computational cost than other schemes for which the sample complexity depends on the design space dimension. To design candidate simple approximating sets, which approximate the shape of the probabilistic set, we introduce two possibilities: i) fixed-complexity polytopes, and ii) $\ell_p$-norm based sets. Once the candidate approximating set is obtained, it is scaled around its center so to enforce the expected probabilistic guarantees. The resulting scaled set is then exploited to enforce constraints in the classical SMPC framework. The computational gain obtained with the proposed approach with respect to the scenario one is demonstrated via simulations, where the objective is the control of a fixed-wing UAV performing a monitoring mission over a sloped vineyard.
SYSep 27, 2015
Sequential Randomized Algorithms for Convex Optimization in the Presence of UncertaintyMohammadreza Chamanbaz, Fabrizio Dabbene, Roberto Tempo et al.
In this paper, we propose new sequential randomized algorithms for convex optimization problems in the presence of uncertainty. A rigorous analysis of the theoretical properties of the solutions obtained by these algorithms, for full constraint satisfaction and partial constraint satisfaction, respectively, is given. The proposed methods allow to enlarge the applicability of the existing randomized methods to real-world applications involving a large number of design variables. Since the proposed approach does not provide a priori bounds on the sample complexity, extensive numerical simulations, dealing with an application to hard-disk drive servo design, are provided. These simulations testify the goodness of the proposed solution.
OCSep 14, 2015
Simple Approximations of Semialgebraic Sets and their Applications to ControlFabrizio Dabbene, Didier Henrion, Constantino Lagoa
Many uncertainty sets encountered in control systems analysis and design can be expressed in terms of semialgebraic sets, that is as the intersection of sets described by means of polynomial inequalities. Important examples are for instance the solution set of linear matrix inequalities or the Schur/Hurwitz stability domains. These sets often have very complicated shapes (non-convex, and even non-connected), which renders very difficult their manipulation. It is therefore of considerable importance to find simple-enough approximations of these sets, able to capture their main characteristics while maintaining a low level of complexity. For these reasons, in the past years several convex approximations, based for instance on hyperrect-angles, polytopes, or ellipsoids have been proposed. In this work, we move a step further, and propose possibly non-convex approximations , based on a small volume polynomial superlevel set of a single positive polynomial of given degree. We show how these sets can be easily approximated by minimizing the L1 norm of the polynomial over the semialgebraic set, subject to positivity constraints. Intuitively, this corresponds to the trace minimization heuristic commonly encounter in minimum volume ellipsoid problems. From a computational viewpoint, we design a hierarchy of linear matrix inequality problems to generate these approximations, and we provide theoretically rigorous convergence results, in the sense that the hierarchy of outer approximations converges in volume (or, equivalently, almost everywhere and almost uniformly) to the original set. Two main applications of the proposed approach are considered. The first one aims at reconstruction/approximation of sets from a finite number of samples. In the second one, we show how the concept of polynomial superlevel set can be used to generate samples uniformly distributed on a given semialgebraic set. The efficiency of the proposed approach is demonstrated by different numerical examples.
OCJul 29, 2015
Randomized Approximations of the Image Set of Nonlinear Mappings with Applications to FilteringFabrizio Dabbene, Didier Henrion, Constantino Lagoa et al.
The aim of this paper is twofold: In the first part, we leverage recent results on scenario design to develop randomized algorithmsfor approximating the image set of a nonlinear mapping, that is, a (possibly noisy) mapping of a set via a nonlinear function.We introduce minimum-volume approximations which have the characteristic of guaranteeing a low probability of violation, i.e.,we admit for a probability that some points in the image set are not contained in the approximating set,but this probability is kept below a pre-specified threshold.In the second part of the paper, this idea is then exploited to develop a new family of randomized prediction-corrector filters.These filters represent a natural extension and rapprochement of Gaussian and set-valued filters,and bear similarities with modern tools such as particle filters.