SYAIMAOct 23, 2019

Online Synthesis for Runtime Enforcement of Safety in Multi-Agent Systems

arXiv:1910.10380v29 citations
Originality Incremental advance
AI Analysis

This addresses safety enforcement in multi-agent systems, offering a scalable solution for applications like robotics and autonomous vehicles, though it is incremental in improving existing shield methods.

The paper tackles the scalability and centralization issues of safety shields in multi-agent systems by introducing a decentralized, runtime synthesis approach, achieving tractable synthesis for 50 agents in seconds compared to intractable design-time methods beyond 4 agents.

A shield is attached to a system to guarantee safety by correcting the system's behavior at runtime. Existing methods that employ design-time synthesis of shields do not scale to multi-agent systems. Moreover, such shields are typically implemented in a centralized manner, requiring global information on the state of all agents in the system. We address these limitations through a new approach where the shields are synthesized at runtime and do not require global information. There is a shield onboard every agent, which can only modify the behavior of the corresponding agent. In this approach, which is fundamentally decentralized, the shield on every agent has two components: a pathfinder that corrects the behavior of the agent and an ordering mechanism that dynamically modifies the priority of the agent. The current priority determines if the shield uses the pathfinder to modify behavior of the agent. We derive an upper bound on the maximum deviation for any agent from its original behavior. We prove that the worst-case synthesis time is quadratic in the number of agents at runtime as opposed to exponential at design-time for existing methods. We test the performance of the decentralized, runtime shield synthesis approach on a collision-avoidance problem. For 50 agents in a 50x50 grid, the synthesis at runtime requires a few seconds per agent whenever a potential collision is detected. In contrast, the centralized design-time synthesis of shields for a similar setting is intractable beyond 4 agents in a 5x5 grid.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes