CLJan 9, 2023

Automatic Standardization of Arabic Dialects for Machine Translation

arXiv:2301.03447v16 citationsh-index: 1
Originality Incremental advance
AI Analysis

This addresses the challenge of translating Arabic dialects, which are less efficient than standard Arabic in machine translation, potentially benefiting translation software and educational tools, though it appears incremental as it applies existing statistical methods to a specific language pair.

The paper tackles the problem of machine translation for Arabic dialects by proposing automatic standardization to convert dialectal Arabic into standard Arabic, using statistical models due to the lack of diglossic dictionaries and linguistic rules, which could improve translation quality and have educational applications.

Based on an annotated multimedia corpus, television series Mar{ā}y{ā} 2013, we dig into the question of ''automatic standardization'' of Arabic dialects for machine translation. Here we distinguish between rule-based machine translation and statistical machine translation. Machine translation from Arabic most of the time takes standard or modern Arabic as the source language and produces quite satisfactory translations thanks to the availability of the translation memories necessary for training the models. The case is different for the translation of Arabic dialects. The productions are much less efficient. In our research we try to apply machine translation methods to a dialect/standard (or modern) Arabic pair to automatically produce a standard Arabic text from a dialect input, a process we call ''automatic standardization''. we opt here for the application of ''statistical models'' because ''automatic standardization'' based on rules is more hard with the lack of ''diglossic'' dictionaries on the one hand and the difficulty of creating linguistic rules for each dialect on the other. Carrying out this research could then lead to combining ''automatic standardization'' software and automatic translation software so that we take the output of the first software and introduce it as input into the second one to obtain at the end a quality machine translation. This approach may also have educational applications such as the development of applications to help understand different Arabic dialects by transforming dialectal texts into standard Arabic.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes