LGAIROApr 14, 2023

A Platform-Agnostic Deep Reinforcement Learning Framework for Effective Sim2Real Transfer towards Autonomous Driving

arXiv:2304.08235v313 citationsh-index: 21
Originality Incremental advance
AI Analysis

This addresses the Sim2Real transfer problem for autonomous driving, but it is incremental as it builds on existing DRL methods with platform-specific adaptations.

The paper tackles the challenge of transferring deep reinforcement learning agents from simulation to reality for autonomous driving by proposing a platform-agnostic framework that uses perception modules to train lane-following and overtaking agents, achieving similar performance in both simulation and the real world with significant reduction in the Sim2Real gap.

Deep Reinforcement Learning (DRL) has shown remarkable success in solving complex tasks across various research fields. However, transferring DRL agents to the real world is still challenging due to the significant discrepancies between simulation and reality. To address this issue, we propose a robust DRL framework that leverages platform-dependent perception modules to extract task-relevant information and train a lane-following and overtaking agent in simulation. This framework facilitates the seamless transfer of the DRL agent to new simulated environments and the real world with minimal effort. We evaluate the performance of the agent in various driving scenarios in both simulation and the real world, and compare it to human players and the PID baseline in simulation. Our proposed framework significantly reduces the gaps between different platforms and the Sim2Real gap, enabling the trained agent to achieve similar performance in both simulation and the real world, driving the vehicle effectively.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes