Fake News Classification in Urdu: A Domain Adaptation Approach for a Low-Resource Language
This addresses misinformation detection for Urdu speakers, but it is incremental as it adapts existing methods to a specific language context.
The paper tackled fake news classification in Urdu, a low-resource language, by applying domain adaptation before fine-tuning multilingual models, resulting in domain-adapted XLM-R consistently outperforming its vanilla version on four datasets.
Misinformation on social media is a widely acknowledged issue, and researchers worldwide are actively engaged in its detection. However, low-resource languages such as Urdu have received limited attention in this domain. An obvious approach is to utilize a multilingual pretrained language model and fine-tune it for a downstream classification task, such as misinformation detection. However, these models struggle with domain-specific terms, leading to suboptimal performance. To address this, we investigate the effectiveness of domain adaptation before fine-tuning for fake news classification in Urdu, employing a staged training approach to optimize model generalization. We evaluate two widely used multilingual models, XLM-RoBERTa and mBERT, and apply domain-adaptive pretraining using a publicly available Urdu news corpus. Experiments on four publicly available Urdu fake news datasets show that domain-adapted XLM-R consistently outperforms its vanilla counterpart, while domain-adapted mBERT exhibits mixed results.