SYAug 29, 2014
Zeros of Networked Systems with Time-invariant InterconnectionsMohsen Zamani, Uwe Helmke, Brian D. O. Anderson
This paper studies zeros of networked linear systems with time-invariant interconnection topology. While the characterization of zeros is given for both heterogeneous and homogeneous networks, homogeneous networks are explored in greater detail. In the current paper, for homogeneous networks with time-invariant interconnection dynamics, it is illustrated how the zeros of each individual agent's system description and zeros definable from the interconnection dynamics contribute to generating zeros of the whole network. We also demonstrate how zeros of networked systems and those of their associated blocked versions are related.
SYNov 21, 2017
Distributed Kalman Filter in a Network of Linear Dynamical SystemsDamian Marelli, Mohsen Zamani, Minyue Fu
This paper is concerned with the problem of distributed Kalman filtering in a network of interconnected subsystems with distributed control protocols. We consider networks, which can be either homogeneous or heterogeneous, of linear time-invariant subsystems, given in the state-space form. We propose a distributed Kalman filtering scheme for this setup. The proposed method provides, at each node, an estimation of the state parameter, only based on locally available measurements and those from the neighbor nodes. The special feature of this method is that it exploits the particular structure of the considered network to obtain an estimate using only one prediction/update step at each time step. We show that the estimate produced by the proposed method asymptotically approaches that of the centralized Kalman filter, i.e., the optimal one with global knowledge of all network parameters, and we are able to bound the convergence rate. Moreover, if the initial states of all subsystems are mutually uncorrelated, the estimates of these two schemes are identical at each time step.
SYMar 14, 2018
Structural Controllability of a Consensus Network with Multiple LeadersMilad M. Kazemi, Mohsen Zamani, Zhiyong Chen
This paper examines the structural controllability for a group of agents, called followers, connected to each other based on the consensus law under commands of multiple leaders, which are agents with superior capabilities, over a fixed communication topology. It is proved that the graph-theoretic sufficient and necessary condition for the set of followers to be structurally controllable under the leaders' commands is leader-follower connectivity of the associated graph topology. This shrinks to graph connectivity for the case of solo leader. In the approach, we explicitly put into account the dependence among the entries of the system matrices for a consensus network using the linear parameterization technique introduced in [1].
SYJun 22, 2018
Subgradient-Free Stochastic Optimization Algorithm for Non-smooth Convex Functions over Time-Varying NetworksYinghui Wang, Wenxiao Zhao, Yiguang Hong et al.
In this paper we consider a distributed stochastic optimization problem without the gradient/subgradient information for the local objective functions, subject to local convex constraints. The objective functions may be non-smooth and observed with stochastic noises, and the network for the distributed design is time-varying. By adding the stochastic dithers into the local objective functions and constructing the randomized differences motivated by the Kiefer-Wolfowitz algorithm, we propose a distributed subgradient-free algorithm to find the global minimizer with local observations. Moreover, we prove that the consensus of estimates and global minimization can be achieved with probability one over the time-varying network, and then obtain the convergence rate of the mean average of estimates as well. Finally, we give a numerical example to illustrate the effectiveness of the proposed algorithm.
LGAug 16, 2021
Optimal Actor-Critic Policy with Optimized Training DatasetsChayan Banerjee, Zhiyong Chen, Nasimul Noman et al.
Actor-critic (AC) algorithms are known for their efficacy and high performance in solving reinforcement learning problems, but they also suffer from low sampling efficiency. An AC based policy optimization process is iterative and needs to frequently access the agent-environment system to evaluate and update the policy by rolling out the policy, collecting rewards and states (i.e. samples), and learning from them. It ultimately requires a huge number of samples to learn an optimal policy. To improve sampling efficiency, we propose a strategy to optimize the training dataset that contains significantly less samples collected from the AC process. The dataset optimization is made of a best episode only operation, a policy parameter-fitness model, and a genetic algorithm module. The optimal policy network trained by the optimized training dataset exhibits superior performance compared to many contemporary AC algorithms in controlling autonomous dynamical systems. Evaluation on standard benchmarks show that the method improves sampling efficiency, ensures faster convergence to optima, and is more data-efficient than its counterparts.
SYOct 10, 2018
Secure and Privacy Preserving Consensus for Second-order Systems Based on Paillier EncryptionWentuo Fang, Mohsen Zamani, Zhiyong Chen
This paper aims at secure and privacy preserving consensus algorithms of networked systems. Due to the technical challenges behind decentralized design of such algorithms, the existing results are mainly restricted to a network of systems with simplest first-order dynamics. Like many other control problems, breakthrough of the gap between first-order dynamics and higher-order ones demands for more advanced technical developments. In this paper, we explore a Paillier encryption based average consensus algorithm for a network of systems with second-order dynamics, with randomness added to network weights. The conditions for privacy preserving, especially depending on consensus rate, are thoroughly studied with theoretical analysis and numerical verification.
SYSep 14, 2018
Probabilistic Optimal Power Flow Considering Correlation of Wind Farms via Markov Chain Quasi-Monte Carlo SamplingWeigao Sun, Mohsen Zamani, Hai-Tao Zhang et al.
The probabilistic characteristics of daily wind speed are not well captured by simple density functions such as Normal or Weibull distribuions as suggested by the existing literature. The unmodeled uncertainties can cause unknown influences on the power system operation. In this paper, we develop a new stochastic scheme for the probabilistic optimal power flow (POPF) problem, which can cope with arbitrarily complex wind speed distributions and also take into account the correlation of different wind farms. A multivariate Gaussian mixture model (GMM) is employed to approximate actual wind speed distributions from multiple wind farms. Furthermore, we propose to adopt the Markov Chain Monte Carlo (MCMC) sampling technique to deliver wind speed samples as the input of POPF. We also novelly integrate a Sobol-based quasi-Monte Carlo (QMC) technique into the MCMC sampling process to obtain a faster convergence rate. The IEEE 14- and 118-bus benchmark systems with additional wind farms are used to examine the effectiveness of the proposed POPF scheme.
SYMay 26, 2015
On the Reachability of Networked SystemsMohsen Zamani, Brett Ninness, Daniel Quevedo
In this paper, we study networks of discrete-time linear time-invariant subsystems. Our focus is on situations where subsystems are connected to each other through a time-invariant topology and where there exists a base-station whose aim is to control the subsystems into any desired destinations. However, the base-station can only communicate with some of the subsystems that we refer to as leaders. There are no direct links between the base-station and the rest of subsystems, known as followers, as they are only able to liaise among themselves and with some of the leaders. The current paper formulates this framework as the well-known reachability problem for linear systems. Then to address this problem, we introduce notions of leader-reachability and base-reachability. We present algebraic conditions under which these notions hold. It turns out that if subsystems are represented by minimal state space representations, then base-reachability always holds. Hence, we focus on leader-reachability and investigate the corresponding conditions in detail. We further demonstrate that when the networked system parameters i.e. subsystems' parameters and interconnection matrices, assume generic values then the whole network is both leader-reachable and base-reachable.