RLOC: Terrain-Aware Legged Locomotion using Reinforcement Learning and Optimal Control
This work provides an incremental improvement in robust quadrupedal locomotion for robotics researchers and practitioners, particularly for dynamic movement over complex terrains.
This paper presents a unified model-based and data-driven approach for quadrupedal locomotion on uneven terrain, mapping sensory information and desired base velocity into footstep plans using a reinforcement learning policy. The method prioritizes stability over aggressive locomotion and demonstrates transferability between different ANYmal robot versions without retraining.
We present a unified model-based and data-driven approach for quadrupedal planning and control to achieve dynamic locomotion over uneven terrain. We utilize on-board proprioceptive and exteroceptive feedback to map sensory information and desired base velocity commands into footstep plans using a reinforcement learning (RL) policy. This RL policy is trained in simulation over a wide range of procedurally generated terrains. When ran online, the system tracks the generated footstep plans using a model-based motion controller. We evaluate the robustness of our method over a wide variety of complex terrains. It exhibits behaviors which prioritize stability over aggressive locomotion. Additionally, we introduce two ancillary RL policies for corrective whole-body motion tracking and recovery control. These policies account for changes in physical parameters and external perturbations. We train and evaluate our framework on a complex quadrupedal system, ANYmal version B, and demonstrate transferability to a larger and heavier robot, ANYmal C, without requiring retraining.