On the Ergodic Control of Ensembles
For control engineers designing large-scale multi-agent systems (e.g., smart grids), this work highlights a potential failure mode of standard PI control and offers a new design approach.
The paper shows that PI control can cause loss of ergodicity in ensemble systems, and proposes a theoretical framework for analysis and design of controllers that regulate aggregate behavior while maintaining ergodicity.
Across smart-grid and smart-city application domains, there are many problems where an ensemble of agents is to be controlled such that both the aggregate behaviour and individual-level perception of the system's performance are acceptable. In many applications, traditional PI control is used to regulate aggregate ensemble performance. Our principal contribution in this note is to demonstrate that PI control may not be always suitable for this purpose, and in some situations may lead to a loss of ergodicity for closed-loop systems. Building on this observation, a theoretical framework is proposed to both analyse and design control systems for the regulation of large scale ensembles of agents with a probabilistic intent. Examples are given to illustrate our results.