Pointly-Supervised Panoptic Segmentation
This addresses the problem of high annotation costs for panoptic segmentation in computer vision, though it is incremental as it builds on existing weakly-supervised methods.
The paper tackles weakly-supervised panoptic segmentation by using point-level annotations instead of dense pixel labels to reduce annotation burden, achieving state-of-the-art performance on Pascal VOC and MS COCO datasets.
In this paper, we propose a new approach to applying point-level annotations for weakly-supervised panoptic segmentation. Instead of the dense pixel-level labels used by fully supervised methods, point-level labels only provide a single point for each target as supervision, significantly reducing the annotation burden. We formulate the problem in an end-to-end framework by simultaneously generating panoptic pseudo-masks from point-level labels and learning from them. To tackle the core challenge, i.e., panoptic pseudo-mask generation, we propose a principled approach to parsing pixels by minimizing pixel-to-point traversing costs, which model semantic similarity, low-level texture cues, and high-level manifold knowledge to discriminate panoptic targets. We conduct experiments on the Pascal VOC and the MS COCO datasets to demonstrate the approach's effectiveness and show state-of-the-art performance in the weakly-supervised panoptic segmentation problem. Codes are available at https://github.com/BraveGroup/PSPS.git.