CVApr 28, 2020

Gradient-Induced Co-Saliency Detection

arXiv:2004.13364v3131 citations
Originality Incremental advance
AI Analysis

It addresses the problem of segmenting common salient objects in image groups for computer vision applications, with incremental improvements in method and dataset creation.

The paper tackles co-saliency detection by proposing a gradient-induced method that uses feedback gradients to focus on discriminative features and a jigsaw training strategy to train on general datasets without extra annotations, achieving state-of-the-art performance on a new challenging dataset.

Co-saliency detection (Co-SOD) aims to segment the common salient foreground in a group of relevant images. In this paper, inspired by human behavior, we propose a gradient-induced co-saliency detection (GICD) method. We first abstract a consensus representation for the grouped images in the embedding space; then, by comparing the single image with consensus representation, we utilize the feedback gradient information to induce more attention to the discriminative co-salient features. In addition, due to the lack of Co-SOD training data, we design a jigsaw training strategy, with which Co-SOD networks can be trained on general saliency datasets without extra pixel-level annotations. To evaluate the performance of Co-SOD methods on discovering the co-salient object among multiple foregrounds, we construct a challenging CoCA dataset, where each image contains at least one extraneous foreground along with the co-salient object. Experiments demonstrate that our GICD achieves state-of-the-art performance. Our codes and dataset are available at https://mmcheng.net/gicd/.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes