CVJun 22, 2023

PromptIR: Prompting for All-in-One Blind Image Restoration

arXiv:2306.13090v1167 citationsh-index: 95Has Code
Originality Highly original
AI Analysis

This addresses the need for a single, efficient model to handle multiple image restoration tasks in real-world applications, reducing the requirement for training individual models for each degradation type.

The paper tackles the problem of limited generalization in deep learning-based image restoration by proposing PromptIR, a prompt-based learning approach that effectively restores images from various degradation types and levels without prior information, achieving state-of-the-art results on tasks like denoising, deraining, and dehazing.

Image restoration involves recovering a high-quality clean image from its degraded version. Deep learning-based methods have significantly improved image restoration performance, however, they have limited generalization ability to different degradation types and levels. This restricts their real-world application since it requires training individual models for each specific degradation and knowing the input degradation type to apply the relevant model. We present a prompt-based learning approach, PromptIR, for All-In-One image restoration that can effectively restore images from various types and levels of degradation. In particular, our method uses prompts to encode degradation-specific information, which is then used to dynamically guide the restoration network. This allows our method to generalize to different degradation types and levels, while still achieving state-of-the-art results on image denoising, deraining, and dehazing. Overall, PromptIR offers a generic and efficient plugin module with few lightweight prompts that can be used to restore images of various types and levels of degradation with no prior information on the corruptions present in the image. Our code and pretrained models are available here: https://github.com/va1shn9v/PromptIR

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes