CLLGJun 12, 2019

Neural Arabic Question Answering

arXiv:1906.05394v11114 citations
Originality Synthesis-oriented
AI Analysis

This tackles the problem of Arabic QA for researchers and practitioners by providing datasets and a baseline system, though it is incremental as it adapts existing methods to a new language.

The paper addresses open domain factual Arabic question answering by creating the ARCD dataset and a system (SOQAL) combining TF-IDF retrieval and BERT, achieving a 61.3 F1 score on ARCD and 27.6 F1 for open domain QA.

This paper tackles the problem of open domain factual Arabic question answering (QA) using Wikipedia as our knowledge source. This constrains the answer of any question to be a span of text in Wikipedia. Open domain QA for Arabic entails three challenges: annotated QA datasets in Arabic, large scale efficient information retrieval and machine reading comprehension. To deal with the lack of Arabic QA datasets we present the Arabic Reading Comprehension Dataset (ARCD) composed of 1,395 questions posed by crowdworkers on Wikipedia articles, and a machine translation of the Stanford Question Answering Dataset (Arabic-SQuAD). Our system for open domain question answering in Arabic (SOQAL) is based on two components: (1) a document retriever using a hierarchical TF-IDF approach and (2) a neural reading comprehension model using the pre-trained bi-directional transformer BERT. Our experiments on ARCD indicate the effectiveness of our approach with our BERT-based reader achieving a 61.3 F1 score, and our open domain system SOQAL achieving a 27.6 F1 score.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes