ROAIMay 14, 2024

A Distributed Approach to Autonomous Intersection Management via Multi-Agent Reinforcement Learning

arXiv:2405.08655v23 citationsh-index: 27ATT@ECAI
Originality Incremental advance
AI Analysis

This addresses traffic management challenges for autonomous vehicles, offering a scalable alternative to centralized methods, though it appears incremental in its application of existing MARL techniques.

The paper tackles the problem of autonomous intersection management by proposing a distributed approach using multi-agent reinforcement learning, eliminating the need for a centralized controller and showing superiority over benchmarks in virtual experiments.

Autonomous intersection management (AIM) poses significant challenges due to the intricate nature of real-world traffic scenarios and the need for a highly expensive centralised server in charge of simultaneously controlling all the vehicles. This study addresses such issues by proposing a novel distributed approach to AIM utilizing multi-agent reinforcement learning (MARL). We show that by leveraging the 3D surround view technology for advanced assistance systems, autonomous vehicles can accurately navigate intersection scenarios without needing any centralised controller. The contributions of this paper thus include a MARL-based algorithm for the autonomous management of a 4-way intersection and also the introduction of a new strategy called prioritised scenario replay for improved training efficacy. We validate our approach as an innovative alternative to conventional centralised AIM techniques, ensuring the full reproducibility of our results. Specifically, experiments conducted in virtual environments using the SMARTS platform highlight its superiority over benchmarks across various metrics.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes