CLIRMar 18, 2022

Offensive Language Detection in Under-resourced Algerian Dialectal Arabic Language

arXiv:2203.10024v114 citationsh-index: 5
Originality Synthesis-oriented
AI Analysis

This addresses the problem of detecting abusive content on social media for Algerian dialectal Arabic speakers, but it is incremental as it applies existing methods to a new dataset.

The paper tackled offensive language detection in Algerian dialectal Arabic, a low-resource language, by building a new corpus of 8.7k annotated texts and testing classifiers like BiLSTM and CNN, achieving acceptable but improvable performance.

This paper addresses the problem of detecting the offensive and abusive content in Facebook comments, where we focus on the Algerian dialectal Arabic which is one of under-resourced languages. The latter has a variety of dialects mixed with different languages (i.e. Berber, French and English). In addition, we deal with texts written in both Arabic and Roman scripts (i.e. Arabizi). Due to the scarcity of works on the same language, we have built a new corpus regrouping more than 8.7k texts manually annotated as normal, abusive and offensive. We have conducted a series of experiments using the state-of-the-art classifiers of text categorisation, namely: BiLSTM, CNN, FastText, SVM and NB. The results showed acceptable performances, but the problem requires further investigation on linguistic features to increase the identification accuracy.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes