Dense Affinity Matching for Few-Shot Segmentation
This work addresses segmentation for novel classes with limited data, offering an efficient solution that is incremental but effective in cross-domain scenarios.
The paper tackles few-shot segmentation by proposing a dense affinity matching framework to improve support-query interactions, achieving competitive performance across ten benchmarks with only 0.68M parameters, particularly excelling in cross-domain tasks.
Few-Shot Segmentation (FSS) aims to segment the novel class images with a few annotated samples. In this paper, we propose a dense affinity matching (DAM) framework to exploit the support-query interaction by densely capturing both the pixel-to-pixel and pixel-to-patch relations in each support-query pair with the bidirectional 3D convolutions. Different from the existing methods that remove the support background, we design a hysteretic spatial filtering module (HSFM) to filter the background-related query features and retain the foreground-related query features with the assistance of the support background, which is beneficial for eliminating interference objects in the query background. We comprehensively evaluate our DAM on ten benchmarks under cross-category, cross-dataset, and cross-domain FSS tasks. Experimental results demonstrate that DAM performs very competitively under different settings with only 0.68M parameters, especially under cross-domain FSS tasks, showing its effectiveness and efficiency.