CVSep 27, 2024

S2O: Static to Openable Enhancement for Articulated 3D Objects

arXiv:2409.18896v219 citationsh-index: 46
AI Analysis

This work addresses the limited scale of interactive 3D datasets for robotic manipulation and embodied AI tasks, but it is incremental as it builds on existing 3D object datasets and methods.

The paper tackles the problem of creating interactive articulated 3D objects from static ones by introducing the S2O task, which involves openable part detection, motion prediction, and interior geometry completion, and finds that while it is possible, methods struggle to generalize to realistic settings.

Despite much progress in large 3D datasets there are currently few interactive 3D object datasets, and their scale is limited due to the manual effort required in their construction. We introduce the static to openable (S2O) task which creates interactive articulated 3D objects from static counterparts through openable part detection, motion prediction, and interior geometry completion. We formulate a unified framework to tackle this task, and curate a challenging dataset of openable 3D objects that serves as a test bed for systematic evaluation. Our experiments benchmark methods from prior work, extended and improved methods, and simple yet effective heuristics for the S2O task. We find that turning static 3D objects into interactively openable counterparts is possible but that all methods struggle to generalize to realistic settings of the task, and we highlight promising future work directions. Our work enables efficient creation of interactive 3D objects for robotic manipulation and embodied AI tasks.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes