CVJun 29, 2021

Text Prior Guided Scene Text Image Super-resolution

arXiv:2106.15368v295 citations
Originality Incremental advance
AI Analysis

This addresses the problem of enhancing low-resolution text images for better recognition, with incremental improvements over existing methods.

The paper tackles scene text image super-resolution by embedding categorical text priors from a recognition model to guide reconstruction, achieving improved visual quality and significantly boosting text recognition accuracy on the TextZoom benchmark.

Scene text image super-resolution (STISR) aims to improve the resolution and visual quality of low-resolution (LR) scene text images, and consequently boost the performance of text recognition. However, most of existing STISR methods regard text images as natural scene images, ignoring the categorical information of text. In this paper, we make an inspiring attempt to embed categorical text prior into STISR model training. Specifically, we adopt the character probability sequence as the text prior, which can be obtained conveniently from a text recognition model. The text prior provides categorical guidance to recover high-resolution (HR) text images. On the other hand, the reconstructed HR image can refine the text prior in return. Finally, we present a multi-stage text prior guided super-resolution (TPGSR) framework for STISR. Our experiments on the benchmark TextZoom dataset show that TPGSR can not only effectively improve the visual quality of scene text images, but also significantly improve the text recognition accuracy over existing STISR methods. Our model trained on TextZoom also demonstrates certain generalization capability to the LR images in other datasets.

Code Implementations2 repos
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes