Context-Dependent Translation Selection Using Convolutional Neural Network
This addresses translation accuracy in machine translation, but it is incremental as it builds on existing methods with a novel neural approach.
The paper tackles the problem of translation selection in statistical machine translation by using a convolutional neural network to judge similarity between phrase pairs, incorporating context, and achieves a significant improvement of up to 1.4 BLEU points over the baseline.
We propose a novel method for translation selection in statistical machine translation, in which a convolutional neural network is employed to judge the similarity between a phrase pair in two languages. The specifically designed convolutional architecture encodes not only the semantic similarity of the translation pair, but also the context containing the phrase in the source language. Therefore, our approach is able to capture context-dependent semantic similarities of translation pairs. We adopt a curriculum learning strategy to train the model: we classify the training examples into easy, medium, and difficult categories, and gradually build the ability of representing phrase and sentence level context by using training examples from easy to difficult. Experimental results show that our approach significantly outperforms the baseline system by up to 1.4 BLEU points.