Style-Consistent 3D Indoor Scene Synthesis with Decoupled Objects
This addresses a need in gaming, film, and AR/VR for more flexible scene editing, though it is incremental as it builds on existing scene synthesis methods by adding object-level control.
The paper tackles the problem of controllable 3D indoor scene synthesis by enabling stylization and decoupling of individual objects, rather than applying styles to entire scenes, resulting in generated scenes that are photorealistic, multi-view consistent, and diverse based on natural language prompts.
Controllable 3D indoor scene synthesis stands at the forefront of technological progress, offering various applications like gaming, film, and augmented/virtual reality. The capability to stylize and de-couple objects within these scenarios is a crucial factor, providing an advanced level of control throughout the editing process. This control extends not just to manipulating geometric attributes like translation and scaling but also includes managing appearances, such as stylization. Current methods for scene stylization are limited to applying styles to the entire scene, without the ability to separate and customize individual objects. Addressing the intricacies of this challenge, we introduce a unique pipeline designed for synthesis 3D indoor scenes. Our approach involves strategically placing objects within the scene, utilizing information from professionally designed bounding boxes. Significantly, our pipeline prioritizes maintaining style consistency across multiple objects within the scene, ensuring a cohesive and visually appealing result aligned with the desired aesthetic. The core strength of our pipeline lies in its ability to generate 3D scenes that are not only visually impressive but also exhibit features like photorealism, multi-view consistency, and diversity. These scenes are crafted in response to various natural language prompts, demonstrating the versatility and adaptability of our model.