Parameterize Structure with Differentiable Template for 3D Shape Generation
This addresses the challenge of creating detailed and editable 3D shapes for applications like computer graphics and CAD, representing an incremental improvement over existing methods.
The paper tackles the problem of generating editable 3D shapes with part semantics by proposing a method that parameterizes shared structure using a differentiable template and fixed-length parameters, achieving effective reconstruction and generation with smooth interpolation as demonstrated in evaluations.
Structural representation is crucial for reconstructing and generating editable 3D shapes with part semantics. Recent 3D shape generation works employ complicated networks and structure definitions relying on hierarchical annotations and pay less attention to the details inside parts. In this paper, we propose the method that parameterizes the shared structure in the same category using a differentiable template and corresponding fixed-length parameters. Specific parameters are fed into the template to calculate cuboids that indicate a concrete shape. We utilize the boundaries of three-view drawings of each cuboid to further describe the inside details. Shapes are represented with the parameters and three-view details inside cuboids, from which the SDF can be calculated to recover the object. Benefiting from our fixed-length parameters and three-view details, our networks for reconstruction and generation are simple and effective to learn the latent space. Our method can reconstruct or generate diverse shapes with complicated details, and interpolate them smoothly. Extensive evaluations demonstrate the superiority of our method on reconstruction from point cloud, generation, and interpolation.