Exploring Segmentation Approaches for Neural Machine Translation of Code-Switched Egyptian Arabic-English Text
This addresses data sparsity for machine translation of code-switched text, which is an incremental improvement in a domain-specific setting.
The paper tackled the challenge of data sparsity in machine translation of code-switched Egyptian Arabic-English text by exploring segmentation approaches, finding that morphology-aware segmenters under-perform in MT but a combination of frequency and morphology-based methods works best in low-resource scenarios.
Data sparsity is one of the main challenges posed by code-switching (CS), which is further exacerbated in the case of morphologically rich languages. For the task of machine translation (MT), morphological segmentation has proven successful in alleviating data sparsity in monolingual contexts; however, it has not been investigated for CS settings. In this paper, we study the effectiveness of different segmentation approaches on MT performance, covering morphology-based and frequency-based segmentation techniques. We experiment on MT from code-switched Arabic-English to English. We provide detailed analysis, examining a variety of conditions, such as data size and sentences with different degrees of CS. Empirical results show that morphology-aware segmenters perform the best in segmentation tasks but under-perform in MT. Nevertheless, we find that the choice of the segmentation setup to use for MT is highly dependent on the data size. For extreme low-resource scenarios, a combination of frequency and morphology-based segmentations is shown to perform the best. For more resourced settings, such a combination does not bring significant improvements over the use of frequency-based segmentation.