Incorporating Syntactic Uncertainty in Neural Machine Translation with Forest-to-Sequence Model
This work addresses the challenge of improving translation quality for low-resource language pairs by mitigating parser errors, though it is incremental as it builds on existing tree-to-sequence methods.
The paper tackles the problem of incorporating syntactic information in Neural Machine Translation to reduce reliance on large parallel datasets, especially for low-resource languages, by proposing a forest-to-sequence model that uses multiple parse trees to handle parser errors, achieving superior results over baseline models in English to German, Chinese, and Persian translation.
Incorporating syntactic information in Neural Machine Translation models is a method to compensate their requirement for a large amount of parallel training text, especially for low-resource language pairs. Previous works on using syntactic information provided by (inevitably error-prone) parsers has been promising. In this paper, we propose a forest-to-sequence Attentional Neural Machine Translation model to make use of exponentially many parse trees of the source sentence to compensate for the parser errors. Our method represents the collection of parse trees as a packed forest, and learns a neural attentional transduction model from the forest to the target sentence. Experiments on English to German, Chinese and Persian translation show the superiority of our method over the tree-to-sequence and vanilla sequence-to-sequence neural translation models.