CVIVNov 17, 2021

Local Texture Estimator for Implicit Representation Function

arXiv:2111.08918v6251 citations
Originality Incremental advance
AI Analysis

This addresses the bottleneck of high-frequency learning in implicit neural representations for image super-resolution, though it appears incremental as it builds on existing deep SR architectures.

The paper tackles the problem of implicit neural functions struggling to learn high-frequency image components by proposing a Local Texture Estimator (LTE) that enables capturing fine details in continuous image reconstruction. The result shows favorable performance against existing deep super-resolution methods with arbitrary-scale factors and the shortest running time compared to previous works.

Recent works with an implicit neural function shed light on representing images in arbitrary resolution. However, a standalone multi-layer perceptron shows limited performance in learning high-frequency components. In this paper, we propose a Local Texture Estimator (LTE), a dominant-frequency estimator for natural images, enabling an implicit function to capture fine details while reconstructing images in a continuous manner. When jointly trained with a deep super-resolution (SR) architecture, LTE is capable of characterizing image textures in 2D Fourier space. We show that an LTE-based neural function achieves favorable performance against existing deep SR methods within an arbitrary-scale factor. Furthermore, we demonstrate that our implementation takes the shortest running time compared to previous works.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes