CVSep 1, 2023

Fast Diffusion EM: a diffusion model for blind inverse problems with application to deconvolution

arXiv:2309.00287v240 citations
Originality Incremental advance
AI Analysis

This addresses the challenge of solving inverse problems with unknown degradations for image restoration applications, representing an incremental improvement over existing methods that assume known degradations.

The authors tackled the problem of blind inverse problems, specifically blind image deblurring, by developing a diffusion model that jointly estimates restored images and unknown degradation parameters like blur kernels, achieving state-of-the-art results in experiments.

Using diffusion models to solve inverse problems is a growing field of research. Current methods assume the degradation to be known and provide impressive results in terms of restoration quality and diversity. In this work, we leverage the efficiency of those models to jointly estimate the restored image and unknown parameters of the degradation model such as blur kernel. In particular, we designed an algorithm based on the well-known Expectation-Minimization (EM) estimation method and diffusion models. Our method alternates between approximating the expected log-likelihood of the inverse problem using samples drawn from a diffusion model and a maximization step to estimate unknown model parameters. For the maximization step, we also introduce a novel blur kernel regularization based on a Plug \& Play denoiser. Diffusion models are long to run, thus we provide a fast version of our algorithm. Extensive experiments on blind image deblurring demonstrate the effectiveness of our method when compared to other state-of-the-art approaches.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes