CVROAug 18, 2021

Panoramic Depth Estimation via Supervised and Unsupervised Learning in Indoor Scenes

arXiv:2108.08076v1
AI Analysis

This work addresses depth estimation for indoor panoramic imaging, offering incremental improvements for applications in machine vision.

The paper tackles panoramic depth estimation in indoor scenes by extending PADENet from outdoor use and fusing stereo matching with deep learning, achieving improved accuracy through enhanced training and method fusion.

Depth estimation, as a necessary clue to convert 2D images into the 3D space, has been applied in many machine vision areas. However, to achieve an entire surrounding 360-degree geometric sensing, traditional stereo matching algorithms for depth estimation are limited due to large noise, low accuracy, and strict requirements for multi-camera calibration. In this work, for a unified surrounding perception, we introduce panoramic images to obtain larger field of view. We extend PADENet first appeared in our previous conference work for outdoor scene understanding, to perform panoramic monocular depth estimation with a focus for indoor scenes. At the same time, we improve the training process of the neural network adapted to the characteristics of panoramic images. In addition, we fuse traditional stereo matching algorithm with deep learning methods and further improve the accuracy of depth predictions. With a comprehensive variety of experiments, this research demonstrates the effectiveness of our schemes aiming for indoor scene perception.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes