CVJul 24, 2021

Personalized Image Semantic Segmentation

arXiv:2107.13978v39 citations
Originality Synthesis-oriented
AI Analysis

It addresses the personalization issue in semantic segmentation for practical applications, but is incremental as it builds on existing methods with a new dataset.

The paper tackles the problem of personalized image semantic segmentation by collecting a new dataset (PIS) and proposing a baseline method that uses inter-image context, which outperforms existing methods on this dataset.

Semantic segmentation models trained on public datasets have achieved great success in recent years. However, these models didn't consider the personalization issue of segmentation though it is important in practice. In this paper, we address the problem of personalized image segmentation. The objective is to generate more accurate segmentation results on unlabeled personalized images by investigating the data's personalized traits. To open up future research in this area, we collect a large dataset containing various users' personalized images called PIS (Personalized Image Semantic Segmentation). We also survey some recent researches related to this problem and report their performance on our dataset. Furthermore, by observing the correlation among a user's personalized images, we propose a baseline method that incorporates the inter-image context when segmenting certain images. Extensive experiments show that our method outperforms the existing methods on the proposed dataset. The code and the PIS dataset will be made publicly available.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes