Learning to Reconstruct 3D Non-Cuboid Room Layout from a Single RGB Image
This work addresses a more realistic indoor reconstruction problem for computer vision applications, though it is incremental as it builds on prior methods with a generalized shape assumption.
This paper tackles the problem of reconstructing 3D room layouts from a single RGB image by moving beyond the cuboid-shape prior to a more general assumption of rooms with a single ceiling, floor, and multiple vertical walls, achieving validated effectiveness and efficiency on public datasets.
Single-image room layout reconstruction aims to reconstruct the enclosed 3D structure of a room from a single image. Most previous work relies on the cuboid-shape prior. This paper considers a more general indoor assumption, i.e., the room layout consists of a single ceiling, a single floor, and several vertical walls. To this end, we first employ Convolutional Neural Networks to detect planes and vertical lines between adjacent walls. Meanwhile, estimating the 3D parameters for each plane. Then, a simple yet effective geometric reasoning method is adopted to achieve room layout reconstruction. Furthermore, we optimize the 3D plane parameters to reconstruct a geometrically consistent room layout between planes and lines. The experimental results on public datasets validate the effectiveness and efficiency of our method.