CLLGAug 6, 2021

Lights, Camera, Action! A Framework to Improve NLP Accuracy over OCR documents

arXiv:2108.02899v114 citationsHas Code
AI Analysis

This addresses the issue of imperfect OCR affecting downstream NLP tasks like NER, providing a practical solution for document digitization, though it is incremental as it builds on existing text restoration methods.

The paper tackles the problem of OCR errors degrading NLP task performance by introducing a framework that uses a document synthesis pipeline to generate degraded data for training a text restoration model, which significantly reduces the NER accuracy gaps caused by OCR errors, including on out-of-domain datasets.

Document digitization is essential for the digital transformation of our societies, yet a crucial step in the process, Optical Character Recognition (OCR), is still not perfect. Even commercial OCR systems can produce questionable output depending on the fidelity of the scanned documents. In this paper, we demonstrate an effective framework for mitigating OCR errors for any downstream NLP task, using Named Entity Recognition (NER) as an example. We first address the data scarcity problem for model training by constructing a document synthesis pipeline, generating realistic but degraded data with NER labels. We measure the NER accuracy drop at various degradation levels and show that a text restoration model, trained on the degraded data, significantly closes the NER accuracy gaps caused by OCR errors, including on an out-of-domain dataset. For the benefit of the community, we have made the document synthesis pipeline available as an open-source project.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes