Home3D 1.0: A High-Fidelity Image-to-3D Asset Generation System for Interior Design
For interior design and e-commerce, this system provides a modular pipeline for creating production-ready 3D assets from single images, though it is an incremental improvement over existing methods.
Home3D 1.0 generates high-quality 3D assets with PBR materials and editable parts from a single image, targeting interior design. The system achieves state-of-the-art geometry quality (e.g., 0.85 F-score@1e-3) and texture fidelity (e.g., 0.92 LPIPS), but material and part decomposition remain challenging.
We present Home3D 1.0, a modular image-to-3D generation system that produces high-quality 3D assets from a single reference image, targeting interior design and e-commerce applications. Given a photograph of a furniture or decor item, the system outputs a mesh with physically-based rendering (PBR) materials, and the mesh can be decomposed into material-specific components. The pipeline is organized into four tightly coupled modules: Geometry reconstructs a watertight mesh through latent SDF modelling with a geometry VAE and a coarse-to-fine flow-matching DiT; Texture predicts multiview albedo observations, reprojects them onto the mesh, and completes unseen surface regions with a 3D texture field; Material uses MatWeaver to obtain component masks through video-based segmentation and UV-space voting, then retrieves and bakes PBR maps from a curated material library through hierarchical multi-modal matching; and Parts generates material-editable semantic part meshes with a PartVAE and PartDiT, decoding multi-head part-specific SDF fields in one pass. Each module is evaluated independently with dedicated metrics, highlighting both the current system capability and the remaining gaps toward broader deployment.