Learning Sampling Dictionaries for Efficient and Generalizable Robot Motion Planning with Transformers
This addresses a key limitation in robotics for applications like autonomous driving and surgical robots, though it appears incremental as it builds on existing learning-based planners.
The paper tackles the problem of motion planning in robotics, where existing methods lack scalability to high-dimensional spaces and learning-based planners lack generalizability to new environments. The proposed VQ-MPT approach achieves higher success rates than previous methods and generates near-optimal paths faster when paired with sampling-based motion planners.
Motion planning is integral to robotics applications such as autonomous driving, surgical robots, and industrial manipulators. Existing planning methods lack scalability to higher-dimensional spaces, while recent learning based planners have shown promise in accelerating sampling-based motion planners (SMP) but lack generalizability to out-of-distribution environments. To address this, we present a novel approach, Vector Quantized-Motion Planning Transformers (VQ-MPT) that overcomes the key generalization and scaling drawbacks of previous learning-based methods. VQ-MPT consists of two stages. Stage 1 is a Vector Quantized-Variational AutoEncoder model that learns to represent the planning space using a finite number of sampling distributions, and stage 2 is an Auto-Regressive model that constructs a sampling region for SMPs by selecting from the learned sampling distribution sets. By splitting large planning spaces into discrete sets and selectively choosing the sampling regions, our planner pairs well with out-of-the-box SMPs, generating near-optimal paths faster than without VQ-MPT's aid. It is generalizable in that it can be applied to systems of varying complexities, from 2D planar to 14D bi-manual robots with diverse environment representations, including costmaps and point clouds. Trained VQ-MPT models generalize to environments unseen during training and achieve higher success rates than previous methods.