Diffgrasp: Whole-Body Grasping Synthesis Guided by Object Motion Using a Diffusion Model
This work addresses the need for high-quality motion synthesis in animation, VR/AR, and robotics, though it appears incremental by building on diffusion models for a specific domain.
The authors tackled the problem of generating whole-body human-object interaction motions with realistic grasping by jointly modeling body, hands, and object motion using a diffusion model, and their approach outperformed the state-of-the-art method.
Generating high-quality whole-body human object interaction motion sequences is becoming increasingly important in various fields such as animation, VR/AR, and robotics. The main challenge of this task lies in determining the level of involvement of each hand given the complex shapes of objects in different sizes and their different motion trajectories, while ensuring strong grasping realism and guaranteeing the coordination of movement in all body parts. Contrasting with existing work, which either generates human interaction motion sequences without detailed hand grasping poses or only models a static grasping pose, we propose a simple yet effective framework that jointly models the relationship between the body, hands, and the given object motion sequences within a single diffusion model. To guide our network in perceiving the object's spatial position and learning more natural grasping poses, we introduce novel contact-aware losses and incorporate a data-driven, carefully designed guidance. Experimental results demonstrate that our approach outperforms the state-of-the-art method and generates plausible whole-body motion sequences.