ROAICVNov 24, 2024

Bimanual Grasp Synthesis for Dexterous Robot Hands

arXiv:2411.15903v113 citationsh-index: 2IEEE Robot Autom Lett
Originality Incremental advance
AI Analysis

This work addresses the underexplored challenge of bimanual grasp synthesis for dexterous robot manipulation, which is incremental as it builds on existing grasp synthesis methods with a new dataset and model.

The paper tackled the problem of generating bimanual grasp poses for dexterous robot hands to handle large and heavy objects, resulting in a dataset of over 150k verified grasps and a diffusion model achieving a 69.87% success rate with accelerated computational speed.

Humans naturally perform bimanual skills to handle large and heavy objects. To enhance robots' object manipulation capabilities, generating effective bimanual grasp poses is essential. Nevertheless, bimanual grasp synthesis for dexterous hand manipulators remains underexplored. To bridge this gap, we propose the BimanGrasp algorithm for synthesizing bimanual grasps on 3D objects. The BimanGrasp algorithm generates grasp poses by optimizing an energy function that considers grasp stability and feasibility. Furthermore, the synthesized grasps are verified using the Isaac Gym physics simulation engine. These verified grasp poses form the BimanGrasp-Dataset, the first large-scale synthesized bimanual dexterous hand grasp pose dataset to our knowledge. The dataset comprises over 150k verified grasps on 900 objects, facilitating the synthesis of bimanual grasps through a data-driven approach. Last, we propose BimanGrasp-DDPM, a diffusion model trained on the BimanGrasp-Dataset. This model achieved a grasp synthesis success rate of 69.87\% and significant acceleration in computational speed compared to BimanGrasp algorithm.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes