Quality Versus Sparsity in Image Recovery by Dictionary Learning Using Iterative Shrinkage
This addresses a practical trade-off in image processing for applications like efficient storage, but it is incremental as it builds on existing sparse dictionary learning methods.
The paper investigates the trade-off between sparsity and recovery quality in image recovery using sparse dictionary learning, finding that high sparsity does not generally compromise quality even with different optimization methods.
Sparse dictionary learning (SDL) is a fundamental technique that is useful for many image processing tasks. As an example we consider here image recovery, where SDL can be cast as a nonsmooth optimization problem. For this kind of problems, iterative shrinkage methods represent a powerful class of algorithms that are subject of ongoing research. Sparsity is an important property of the learned solutions, as exactly the sparsity enables efficient further processing or storage. The sparsity implies that a recovered image is determined as a combination of a number of dictionary elements that is as low as possible. Therefore, the question arises, to which degree sparsity should be enforced in SDL in order to not compromise recovery quality. In this paper we focus on the sparsity of solutions that can be obtained using a variety of optimization methods. It turns out that there are different sparsity regimes depending on the method in use. Furthermore, we illustrate that high sparsity does in general not compromise recovery quality, even if the recovered image is quite different from the learning database.