HouseLayout3D: A Benchmark and Training-Free Baseline for 3D Layout Estimation in the Wild
This work addresses the challenge of full building-scale layout estimation for researchers and applications in scene understanding, though it is incremental as it builds on existing methods.
The authors tackled the problem of 3D layout estimation for large multi-floor buildings by introducing HouseLayout3D, a real-world benchmark, and MultiFloor3D, a training-free baseline that outperforms existing models on this and prior datasets.
Current 3D layout estimation models are primarily trained on synthetic datasets containing simple single room or single floor environments. As a consequence, they cannot natively handle large multi floor buildings and require scenes to be split into individual floors before processing, which removes global spatial context that is essential for reasoning about structures such as staircases that connect multiple levels. In this work, we introduce HouseLayout3D, a real world benchmark designed to support progress toward full building scale layout estimation, including multiple floors and architecturally intricate spaces. We also present MultiFloor3D, a simple training free baseline that leverages recent scene understanding methods and already outperforms existing 3D layout estimation models on both our benchmark and prior datasets, highlighting the need for further research in this direction. Data and code are available at: https://houselayout3d.github.io.