CLLGMLJun 13, 2018

Extracting Parallel Sentences with Bidirectional Recurrent Neural Networks to Improve Machine Translation

arXiv:1806.05559v21093 citations
AI Analysis

This work addresses the data sparsity problem for machine translation systems, but it is incremental as it builds on existing neural network approaches without introducing a new paradigm.

The authors tackled the problem of data sparsity in multilingual NLP by proposing a bidirectional RNN method to extract parallel sentences from noisy corpora, achieving promising results against a baseline and showing significant improvements in machine translation performance when using extracted sentences from Wikipedia.

Parallel sentence extraction is a task addressing the data sparsity problem found in multilingual natural language processing applications. We propose a bidirectional recurrent neural network based approach to extract parallel sentences from collections of multilingual texts. Our experiments with noisy parallel corpora show that we can achieve promising results against a competitive baseline by removing the need of specific feature engineering or additional external resources. To justify the utility of our approach, we extract sentence pairs from Wikipedia articles to train machine translation systems and show significant improvements in translation performance.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes