ROAINov 15, 2018

Intervention Aided Reinforcement Learning for Safe and Practical Policy Optimization in Navigation

arXiv:1811.06187v133 citations
Originality Incremental advance
AI Analysis

This addresses safety and cost issues in practical navigation applications, such as for UAVs, but appears incremental as it builds on existing reinforcement learning methods with human intervention.

The paper tackles safety and cost challenges in reinforcement learning for navigation by proposing an Intervention Aided Reinforcement Learning (IARL) framework that uses human intervention during robot-environment interaction, showing it substantially reduces human intervention and improves autonomous navigation performance while ensuring safety and acceptable training costs.

Combining deep neural networks with reinforcement learning has shown great potential in the next-generation intelligent control. However, there are challenges in terms of safety and cost in practical applications. In this paper, we propose the Intervention Aided Reinforcement Learning (IARL) framework, which utilizes human intervened robot-environment interaction to improve the policy. We used the Unmanned Aerial Vehicle (UAV) as the test platform. We built neural networks as our policy to map sensor readings to control signals on the UAV. Our experiment scenarios cover both simulation and reality. We show that our approach substantially reduces the human intervention and improves the performance in autonomous navigation, at the same time it ensures safety and keeps training cost acceptable.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes