LGAIROSYDSOCMar 22, 2023

Adaptive Road Configurations for Improved Autonomous Vehicle-Pedestrian Interactions using Reinforcement Learning

arXiv:2303.12289v17 citationsh-index: 33
Originality Incremental advance
AI Analysis

This addresses urban road infrastructure management for autonomous vehicle deployment, but it is incremental as it builds on existing design approaches and control models.

This study tackled the problem of dynamically generating Right-Of-Way plans for autonomous vehicles and pedestrians using Reinforcement Learning, resulting in improved traffic flow efficiency and more pedestrian space, with the distributive learning algorithm outperforming the centralised one in metrics like computational cost (49.55%) and benchmark rewards (25.35%).

The deployment of Autonomous Vehicles (AVs) poses considerable challenges and unique opportunities for the design and management of future urban road infrastructure. In light of this disruptive transformation, the Right-Of-Way (ROW) composition of road space has the potential to be renewed. Design approaches and intelligent control models have been proposed to address this problem, but we lack an operational framework that can dynamically generate ROW plans for AVs and pedestrians in response to real-time demand. Based on microscopic traffic simulation, this study explores Reinforcement Learning (RL) methods for evolving ROW compositions. We implement a centralised paradigm and a distributive learning paradigm to separately perform the dynamic control on several road network configurations. Experimental results indicate that the algorithms have the potential to improve traffic flow efficiency and allocate more space for pedestrians. Furthermore, the distributive learning algorithm outperforms its centralised counterpart regarding computational cost (49.55\%), benchmark rewards (25.35\%), best cumulative rewards (24.58\%), optimal actions (13.49\%) and rate of convergence. This novel road management technique could potentially contribute to the flow-adaptive and active mobility-friendly streets in the AVs era.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes