CVJul 12, 2016

RGBD Salient Object Detection via Deep Fusion

arXiv:1607.03333v1370 citations
Originality Incremental advance
AI Analysis

This addresses the challenge of integrating diverse saliency cues for improved object detection in RGBD images, representing an incremental advancement in computer vision.

The paper tackles the problem of effectively fusing low-level saliency cues for RGBD salient object detection by designing a convolutional neural network that uses saliency feature vectors as input and integrates a Laplacian propagation framework, resulting in consistent outperformance over state-of-the-art methods on three datasets.

Numerous efforts have been made to design different low level saliency cues for the RGBD saliency detection, such as color or depth contrast features, background and color compactness priors. However, how these saliency cues interact with each other and how to incorporate these low level saliency cues effectively to generate a master saliency map remain a challenging problem. In this paper, we design a new convolutional neural network (CNN) to fuse different low level saliency cues into hierarchical features for automatically detecting salient objects in RGBD images. In contrast to the existing works that directly feed raw image pixels to the CNN, the proposed method takes advantage of the knowledge in traditional saliency detection by adopting various meaningful and well-designed saliency feature vectors as input. This can guide the training of CNN towards detecting salient object more effectively due to the reduced learning ambiguity. We then integrate a Laplacian propagation framework with the learned CNN to extract a spatially consistent saliency map by exploiting the intrinsic structure of the input image. Extensive quantitative and qualitative experimental evaluations on three datasets demonstrate that the proposed method consistently outperforms state-of-the-art methods.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes