Attacking the V: On the Resiliency of Adaptive-Horizon MPC
This work provides a theoretical and empirical analysis of adversarial resilience in adaptive-horizon MPC for flocking control, but the problem is domain-specific and the results are incremental.
The paper introduces a V-formation game between a controller using Adaptive-Horizon MPC (AMPC) and an attacker, proving that under controllability assumptions the controller attains V-formation with probability 1. However, with resource constraints, attackers can sometimes win; for bird-removal with R=1 the controller almost always wins, but for R=2 the outcome depends on which birds are removed, and AMPC-enabled attackers outperform naive ones.
We introduce the concept of a V-formation game between a controller and an attacker, where controller's goal is to maneuver the plant (a simple model of flocking dynamics) into a V-formation, and the goal of the attacker is to prevent the controller from doing so. Controllers in V-formation games utilize a new formulation of model-predictive control we call Adaptive-Horizon MPC (AMPC), giving them extraordinary power: we prove that under certain controllability assumptions, an AMPC controller is able to attain V-formation with probability 1. We define several classes of attackers, including those that in one move can remove R birds from the flock, or introduce random displacement into flock dynamics. We consider both naive attackers, whose strategies are purely probabilistic, and AMPC-enabled attackers, putting them on par strategically with the controllers. While an AMPC-enabled controller is expected to win every game with probability 1, in practice, it is resource-constrained: its maximum prediction horizon and the maximum number of game execution steps are fixed. Under these conditions, an attacker has a much better chance of winning a V-formation game. Our extensive performance evaluation of V-formation games uses statistical model checking to estimate the probability an attacker can thwart the controller. Our results show that for the bird-removal game with R = 1, the controller almost always wins (restores the flock to a V-formation). For R = 2, the game outcome critically depends on which two birds are removed. For the displacement game, our results again demonstrate that an intelligent attacker, i.e. one that uses AMPC in this case, significantly outperforms its naive counterpart that randomly executes its attack.