Learning to Recover: Dynamic Reward Shaping with Wheel-Leg Coordination for Fallen Robots
This work addresses the challenge of robust fall recovery for wheeled-legged robots, which is crucial for their practical deployment, representing a strong specific gain in robotics.
The paper tackles the problem of enabling wheeled-legged robots to recover from falls by developing a learning-based framework that integrates dynamic reward shaping and curriculum learning, achieving recovery success rates up to 99.1% and 97.8% and reducing joint torque consumption by 15.8% and 26.2%.
Adaptive recovery from fall incidents are essential skills for the practical deployment of wheeled-legged robots, which uniquely combine the agility of legs with the speed of wheels for rapid recovery. However, traditional methods relying on preplanned recovery motions, simplified dynamics or sparse rewards often fail to produce robust recovery policies. This paper presents a learning-based framework integrating Episode-based Dynamic Reward Shaping and curriculum learning, which dynamically balances exploration of diverse recovery maneuvers with precise posture refinement. An asymmetric actor-critic architecture accelerates training by leveraging privileged information in simulation, while noise-injected observations enhance robustness against uncertainties. We further demonstrate that synergistic wheel-leg coordination reduces joint torque consumption by 15.8% and 26.2% and improves stabilization through energy transfer mechanisms. Extensive evaluations on two distinct quadruped platforms achieve recovery success rates up to 99.1% and 97.8% without platform-specific tuning. The supplementary material is available at https://boyuandeng.github.io/L2R-WheelLegCoordination/