ROLGDec 17, 2024

Multi-Task Reinforcement Learning for Quadrotors

arXiv:2412.12442v125 citationsh-index: 18IEEE Robot Autom Lett
Originality Incremental advance
AI Analysis

This work addresses the need for adaptable quadrotor control policies in robotics, though it is incremental as it builds on existing multi-task RL methods.

The paper tackles the problem of quadrotor control policies struggling with novel tasks by introducing a multi-task reinforcement learning framework, which outperforms baseline approaches in sample efficiency and task performance in both simulation and real-world scenarios.

Reinforcement learning (RL) has shown great effectiveness in quadrotor control, enabling specialized policies to develop even human-champion-level performance in single-task scenarios. However, these specialized policies often struggle with novel tasks, requiring a complete retraining of the policy from scratch. To address this limitation, this paper presents a novel multi-task reinforcement learning (MTRL) framework tailored for quadrotor control, leveraging the shared physical dynamics of the platform to enhance sample efficiency and task performance. By employing a multi-critic architecture and shared task encoders, our framework facilitates knowledge transfer across tasks, enabling a single policy to execute diverse maneuvers, including high-speed stabilization, velocity tracking, and autonomous racing. Our experimental results, validated both in simulation and real-world scenarios, demonstrate that our framework outperforms baseline approaches in terms of sample efficiency and overall task performance.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes