CVApr 6, 2023

Super-Resolving Face Image by Facial Parsing Information

arXiv:2304.02923v113 citationsh-index: 28Has Code
Originality Incremental advance
AI Analysis

This work addresses the problem of enhancing low-resolution face images for applications like surveillance or forensics, representing an incremental improvement over existing methods.

The paper tackles face super-resolution by introducing a network that uses facial parsing maps extracted from low-resolution images to guide the process, achieving state-of-the-art results in quantitative metrics and visual quality.

Face super-resolution is a technology that transforms a low-resolution face image into the corresponding high-resolution one. In this paper, we build a novel parsing map guided face super-resolution network which extracts the face prior (i.e., parsing map) directly from low-resolution face image for the following utilization. To exploit the extracted prior fully, a parsing map attention fusion block is carefully designed, which can not only effectively explore the information of parsing map, but also combines powerful attention mechanism. Moreover, in light of that high-resolution features contain more precise spatial information while low-resolution features provide strong contextual information, we hope to maintain and utilize these complementary information. To achieve this goal, we develop a multi-scale refine block to maintain spatial and contextual information and take advantage of multi-scale features to refine the feature representations. Experimental results demonstrate that our method outperforms the state-of-the-arts in terms of quantitative metrics and visual quality. The source codes will be available at https://github.com/wcy-cs/FishFSRNet.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes