CVAINov 25, 2022

WSSL: Weighted Self-supervised Learning Framework For Image-inpainting

arXiv:2211.13856v2h-index: 6
Originality Incremental advance
AI Analysis

This addresses image inpainting for computer vision applications, but appears incremental as it builds on self-supervised learning with new weighting and loss components.

The paper tackles the problem of image inpainting by proposing a Weighted Self-Supervised Learning (WSSL) framework and a novel loss function, resulting in outperformance over previous methods and more visually appealing images.

Image inpainting is the process of regenerating lost parts of the image. Supervised algorithm-based methods have shown excellent results but have two significant drawbacks. They do not perform well when tested with unseen data. They fail to capture the global context of the image, resulting in a visually unappealing result. We propose a novel self-supervised learning framework for image-inpainting: Weighted Self-Supervised Learning (WSSL) to tackle these problems. We designed WSSL to learn features from multiple weighted pretext tasks. These features are then utilized for the downstream task, image-inpainting. To improve the performance of our framework and produce more visually appealing images, we also present a novel loss function for image inpainting. The loss function takes advantage of both reconstruction loss and perceptual loss functions to regenerate the image. Our experimentation shows WSSL outperforms previous methods, and our loss function helps produce better results.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes