A fully automated and scalable Parallel Data Augmentation for Low Resource Languages using Image and Text Analytics
This addresses the data scarcity issue for low-resource languages, enabling better NLP tools for underserved populations, though it is incremental in its approach.
The paper tackles the problem of limited parallel data for low-resource languages by developing a fully automated method to extract bilingual corpora from newspaper articles, improving machine translation baselines by nearly 3 BLEU points.
Linguistic diversity across the world creates a disparity with the availability of good quality digital language resources thereby restricting the technological benefits to majority of human population. The lack or absence of data resources makes it difficult to perform NLP tasks for low-resource languages. This paper presents a novel scalable and fully automated methodology to extract bilingual parallel corpora from newspaper articles using image and text analytics. We validate our approach by building parallel data corpus for two different language combinations and demonstrate the value of this dataset through a downstream task of machine translation and improve over the current baseline by close to 3 BLEU points.