SPARK: Sim-ready Part-level Articulated Reconstruction with VLM Knowledge
This addresses the need for efficient creation of articulated assets for embodied AI, robotics, and interactive scene understanding, representing a novel method rather than an incremental improvement.
The paper tackles the labor-intensive problem of creating simulation-ready articulated 3D objects by introducing SPARK, a framework that reconstructs physically consistent, kinematic part-level articulated objects from a single RGB image, achieving high-quality results across diverse categories.
Articulated 3D objects are critical for embodied AI, robotics, and interactive scene understanding, yet creating simulation-ready assets remains labor-intensive and requires expert modeling of part hierarchies and motion structures. We introduce SPARK, a framework for reconstructing physically consistent, kinematic part-level articulated objects from a single RGB image. Given an input image, we first leverage VLMs to extract coarse URDF parameters and generate part-level reference images. We then integrate the part-image guidance and the inferred structure graph into a generative diffusion transformer to synthesize consistent part and complete shapes of articulated objects. To further refine the URDF parameters, we incorporate differentiable forward kinematics and differentiable rendering to optimize joint types, axes, and origins under VLM-generated open-state supervision. Extensive experiments show that SPARK produces high-quality, simulation-ready articulated assets across diverse categories, enabling downstream applications such as robotic manipulation and interaction modeling. Project page: https://heyumeng.com/SPARK/index.html.