Pano2CAD: Room Layout From A Single Panorama Image
This addresses the challenge of 3D scene understanding for applications like robotics or augmented reality, but it is incremental as it builds on existing assumptions and methods.
The paper tackles the problem of estimating room geometry and 3D object poses from a single panorama image, achieving quantitative results on synthetic and real datasets.
This paper presents a method of estimating the geometry of a room and the 3D pose of objects from a single 360-degree panorama image. Assuming Manhattan World geometry, we formulate the task as a Bayesian inference problem in which we estimate positions and orientations of walls and objects. The method combines surface normal estimation, 2D object detection and 3D object pose estimation. Quantitative results are presented on a dataset of synthetically generated 3D rooms containing objects, as well as on a subset of hand-labeled images from the public SUN360 dataset.