Paul M.J. Van den Hof

Harm Weerts, Paul M. J. Van den Hof, Arne Dankers

A recent development in data-driven modelling addresses the problem of identifying dynamic models of interconnected systems, represented as linear dynamic networks. For these networks the notion network identifiability has been introduced recently, which reflects the property that different network models can be distinguished from each other. Network identifiability is extended to cover the uniqueness of a single module in the network model. Conditions for single module identifiability are derived and formulated in terms of path-based topological properties of the network models.

Shengling Shi, Giulio Bottegal, Paul M. J. Van den Hof

In networks of dynamic systems, one challenge is to identify the interconnection structure on the basis of measured signals. Inspired by a Bayesian approach in [1], in this paper, we explore a Bayesian model selection method for identifying the connectivity of networks of transfer functions, without the need to estimate the dynamics. The algorithm employs a Bayesian measure and a forward-backward search algorithm. To obtain the Bayesian measure, the impulse responses of network modules are modeled as Gaussian processes and the hyperparameters are estimated by marginal likelihood maximization using the expectation-maximization algorithm. Numerical results demonstrate the effectiveness of this method.

Paul M. J. Van den Hof, Karthik R. Ramaswamy, Arne G. Dankers et al.

The identification of local modules in dynamic networks with known topology has recently been addressed by formulating conditions for arriving at consistent estimates of the module dynamics, typically under the assumption of having disturbances that are uncorrelated over the different nodes. The conditions typically reflect the selection of a set of node signals that are taken as predictor inputs in a MISO identification setup. In this paper an extension is made to arrive at an identification setup for the situation that process noises on the different node signals can be correlated with each other. In this situation the local module may need to be embedded in a MIMO identification setup for arriving at a consistent estimate with maximum likelihood properties. This requires the proper treatment of confounding variables. The result is an algorithm that, based on the given network topology and disturbance correlation structure, selects an appropriate set of node signals as predictor inputs and outputs in a MISO or MIMO identification setup. As a first step in the analysis, we restrict attention to the (slightly conservative) situation where the selected output node signals are predicted based on all of their in-neighbor node signals in the network.

E. M. M., Kivits, Paul M. J. Van den Hof

Physical dynamic networks most commonly consist of interconnections of physical components that can be described by diffusive couplings. These diffusive couplings imply that the cause-effect relationships in the interconnections are symmetric and therefore physical dynamic networks can be represented by undirected graphs. This paper shows how prediction error identification methods developed for linear time-invariant systems in polynomial form can be configured to consistently identify the parameters and the interconnection structure of diffusively coupled networks. Further, a multi-step least squares convex optimization algorithm is developed to solve the nonconvex optimization problem that results from the identification method.

E. M. M., Kivits, Paul M. J. Van den Hof

Dynamic networks consist of interconnected dynamical systems. The subsystems can be viewed as transformations of input signals into output signals, where signals flow from one system into another through interconnections. The signal flows represent directions of information flow, thus a dynamic network can be visualised by a directed graph. In contrast, natural and physical laws only impose relations between systems variables, while variables are shared among systems via interconnections. Sharing is independent of direction, and therefore a dynamic network originating from physics can be visualised by an undirected graph. Typically, dynamic networks are considered to have either directed or undirected interconnections. For both situations, network models, analytic tools, and identification algorithms have been developed. However, dynamic networks can also have both directed and undirected interconnections, for example, in physical networks equipped with digital controllers. In this work, we present mixed linear dynamic networks that contain both undirected and directed interconnections, where the nature of the interconnecting dynamics needs to be incorporated into the modelling framework, identifiability analysis, and identification procedure. For these mixed networks, we derive dynamic network models; formulate conditions for consistent identification of all dynamics in the network; and develop a tractable identification algorithm that delivers consistent estimates.

Karthik R. Ramaswamy, Giulio Bottegal, Paul M. J. Van den Hof

In order to identify a system (module) embedded in a dynamic network, one has to formulate a multiple-input estimation problem that necessitates certain nodes to be measured and included as predictor inputs. However, some of these nodes may not be measurable in many practical cases due to sensor selection and placement issues. This may result in biased estimates of the target module. Furthermore, the identification problem associated with the multiple-input structure may require determining a large number of parameters that are not of particular interest to the experimenter, with increased computational complexity in large-sized networks. In this paper, we tackle these problems by using a data augmentation strategy that allows us to reconstruct the missing node measurements and increase the accuracy of the estimated target module. To this end, we develop a system identification method using regularized kernel-based methods coupled with approximate inference methods. Keeping a parametric model for the module of interest, we model the other modules as Gaussian Processes (GP) with a kernel given by the so-called stable spline kernel. An Empirical Bayes (EB) approach is used to estimate the parameters of the target module. The related optimization problem is solved using an Expectation-Maximization (EM) method, where we employ a Markov-chain Monte Carlo (MCMC) technique to reconstruct the unknown missing node information and the network dynamics. Numerical simulations on dynamic network examples illustrate the potentials of the developed method.

Tom R. V. Steentjes, Mircea Lazar, Paul M. J. Van den Hof

The problem of identifying single modules in multiple-input-single-output (MISO) systems is considered. A novel approach to distributed identification of MISO finite impulse response systems is presented. The distributed identification is discerned by the local estimation of local parameters, which correspond to a module in the MISO system. The local estimators are derived from the standard recursive least squares estimator and require limited information exchange. By Lyapunov's second method, sufficient conditions are derived for asymptotic convergence of the estimators to the true parameters in the absence of disturbances, which lead to asymptotic unbiasedness in the presence of additive output disturbances.

Paul M. J. Van den Hof, Shengling Shi, Stefanie J. M. Fonken et al.

When estimating a single subsystem (module) in a linear dynamic network with a prediction error method, a data-informativity condition needs to be satisfied for arriving at a consistent module estimate. This concerns a condition on input signals in the constructed, possibly MIMO (multiple input multiple output) predictor model being persistently exciting, which is typically guaranteed if the input spectrum is positive definite for a sufficient number of frequencies. Generically, the condition can be formulated as a path-based condition on the graph of the network model. The current condition has two elements of possible conservatism: (a) rather than focussing on the full MIMO model, one would like to be able to focus on consistently estimating the target module only, and (b) structural information, such as structural zero elements in the interconnection structure or known subsystems, should be taken into account. In this paper relaxed conditions for data-informativity are derived addressing these two issues, leading to relaxed path-based conditions on the network graph. This leads to experimental conditions that are less strict, i.e. require a smaller number of external excitation signals. Additionally, the new expressions for data-informativity in identification are shown to be closely related to earlier derived conditions for (generic) single module identifiability.

M. Mohsin Siraj, Max G. Potters, Paul M. J. Van den Hof

Recent developments in science and engineering have motivated control systems to be considered as interconnected and networked systems. From a system identification point of view, modelling of a local module in such a structured system is a relevant and interesting problem. This work focuses on the quality, in terms of variance, of an estimate of a local module. We analyse which predictor input signals are relevant and contribute to variance reduction, while still guaranteeing the consistency of the estimate. For a targeted local module, a comparison of its estimate variance is made between a full-MISO approach and an immersed network setting, where a reduced number of inputs is used, while still guaranteeing consistency. A case study of a four-node network is considered and it is shown that a smaller set of predictor inputs can, under some conditions, result in a smaller variance compared to the full-MISO approach.

Stefanie J. M. Fonken, Karthik R. Ramaswamy, Paul M. J. Van den Hof

Identification methods for dynamic networks typically require prior knowledge of the network and disturbance topology, and often rely on solving poorly scalable non-convex optimization problems. While methods for estimating network topology are available in the literature, less attention has been paid to estimating the disturbance topology, i.e., the (spatial) noise correlation structure and the noise rank in a filtered white noise representation of the disturbance signal. In this work we present an identification method for dynamic networks, in which an estimation of the disturbance topology precedes the identification of the full dynamic network with known network topology. To this end we extend the multi-step Sequential Linear Regression and Weighted Null Space Fitting methods to deal with reduced rank noise, and use these methods to estimate the disturbance topology and the network dynamics in the full measurement situation. As a result, we provide a multi-step least squares algorithm with parallel computation capabilities and that rely only on explicit analytical solutions, thereby avoiding the usual non-convex optimizations involved. Consequently we consistently estimate dynamic networks of Box Jenkins model structure, while keeping the computational burden low. We provide a consistency proof that includes path-based data informativity conditions for allocation of excitation signals in the experimental design. Numerical simulations performed on a dynamic network with reduced rank noise clearly illustrate the potential of this method.

Sofie Haesaert, Paul M. J. Van den Hof, Alessandro Abate

Current state-of-the-art correct-by-design controllers are designed for full-state measurable systems. This work first extends the applicability of correct-by-design controllers to partially observable LTI systems. Leveraging 2nd order bounds we give a design method that has a quantifiable robustness to probabilistic disturbances on state transitions and on output measurements. In a case study from smart buildings we evaluate the new output-based correct-by-design controller on a physical system with limited sensor information.

Sofie Haesaert, Paul M. J. Van den Hof, Alessandro Abate

This work develops a measurement-driven and model-based formal verification approach, applicable to systems with partly unknown dynamics. We provide a principled method, grounded on reachability analysis and on Bayesian inference, to compute the confidence that a physical system driven by external inputs and accessed under noisy measurements, verifies a temporal logic property. A case study is discussed, where we investigate the bounded- and unbounded-time safety of a partly unknown linear time invariant system.