InterAct: Advancing Large-Scale Versatile 3D Human-Object Interaction Generation
This addresses dataset limitations for researchers in 3D human-object interaction generation, though it appears incremental as it builds on existing data sources with quality improvements.
The paper tackles the challenge of generating dynamic 3D human-object interactions by introducing InterAct, a large-scale benchmark that consolidates 21.81 hours of data, optimizes it to reduce artifacts, expands it to 30.70 hours, and achieves state-of-the-art performance on six defined tasks.
While large-scale human motion capture datasets have advanced human motion generation, modeling and generating dynamic 3D human-object interactions (HOIs) remain challenging due to dataset limitations. Existing datasets often lack extensive, high-quality motion and annotation and exhibit artifacts such as contact penetration, floating, and incorrect hand motions. To address these issues, we introduce InterAct, a large-scale 3D HOI benchmark featuring dataset and methodological advancements. First, we consolidate and standardize 21.81 hours of HOI data from diverse sources, enriching it with detailed textual annotations. Second, we propose a unified optimization framework to enhance data quality by reducing artifacts and correcting hand motions. Leveraging the principle of contact invariance, we maintain human-object relationships while introducing motion variations, expanding the dataset to 30.70 hours. Third, we define six benchmarking tasks and develop a unified HOI generative modeling perspective, achieving state-of-the-art performance. Extensive experiments validate the utility of our dataset as a foundational resource for advancing 3D human-object interaction generation. To support continued research in this area, the dataset is publicly available at https://github.com/wzyabcas/InterAct, and will be actively maintained.