LGIVMLFeb 26, 2019

GAN-based Projector for Faster Recovery with Convergence Guarantees in Linear Inverse Problems

arXiv:1902.09698v220 citations
AI Analysis

This method improves efficiency and reduces measurement needs for linear inverse problems like compressed sensing and super-resolution, though it is incremental as it builds on existing GAN-based priors.

The paper tackles the problem of slow recovery in linear inverse problems using GAN-based priors by proposing a network-based projector for projected gradient descent, achieving a 60-80x speed-up over prior methods with better accuracy and requiring 5-10x fewer measurements than random matrices for comparable performance.

A Generative Adversarial Network (GAN) with generator $G$ trained to model the prior of images has been shown to perform better than sparsity-based regularizers in ill-posed inverse problems. Here, we propose a new method of deploying a GAN-based prior to solve linear inverse problems using projected gradient descent (PGD). Our method learns a network-based projector for use in the PGD algorithm, eliminating expensive computation of the Jacobian of $G$. Experiments show that our approach provides a speed-up of $60\text{-}80\times$ over earlier GAN-based recovery methods along with better accuracy. Our main theoretical result is that if the measurement matrix is moderately conditioned on the manifold range($G$) and the projector is $δ$-approximate, then the algorithm is guaranteed to reach $O(δ)$ reconstruction error in $O(log(1/δ))$ steps in the low noise regime. Additionally, we propose a fast method to design such measurement matrices for a given $G$. Extensive experiments demonstrate the efficacy of this method by requiring $5\text{-}10\times$ fewer measurements than random Gaussian measurement matrices for comparable recovery performance. Because the learning of the GAN and projector is decoupled from the measurement operator, our GAN-based projector and recovery algorithm are applicable without retraining to all linear inverse problems, as confirmed by experiments on compressed sensing, super-resolution, and inpainting.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes