Boosting Salient Object Detection with Knowledge Distillated from Large Foundation Models
This work addresses the annotation bottleneck for researchers and practitioners in computer vision, offering a more efficient and scalable solution for Salient Object Detection, though it appears incremental as it builds on existing foundation models and dataset expansion.
The paper tackles the time-consuming manual annotation in Salient Object Detection by developing a low-cost, high-precision method using large foundation models to generate pseudo-labels, and introduces a new dataset BDS-TR and an edge decoder, achieving significant outperformance over state-of-the-art approaches on five benchmark datasets.
Salient Object Detection (SOD) aims to identify and segment prominent regions within a scene. Traditional models rely on manually annotated pseudo labels with precise pixel-level accuracy, which is time-consuming. We developed a low-cost, high-precision annotation method by leveraging large foundation models to address the challenges. Specifically, we use a weakly supervised approach to guide large models in generating pseudo-labels through textual prompts. Since large models do not effectively focus on the salient regions of images, we manually annotate a subset of text to fine-tune the model. Based on this approach, which enables precise and rapid generation of pseudo-labels, we introduce a new dataset, BDS-TR. Compared to the previous DUTS-TR dataset, BDS-TR is more prominent in scale and encompasses a wider variety of categories and scenes. This expansion will enhance our model's applicability across a broader range of scenarios and provide a more comprehensive foundational dataset for future SOD research. Additionally, we present an edge decoder based on dynamic upsampling, which focuses on object edges while gradually recovering image feature resolution. Comprehensive experiments on five benchmark datasets demonstrate that our method significantly outperforms state-of-the-art approaches and also surpasses several existing fully-supervised SOD methods. The code and results will be made available.