A Catalog of Basque Dialectal Resources: Online Collections and Standard-to-Dialectal Adaptations
This addresses the data scarcity issue for researchers and practitioners working on Basque dialectal NLP, though it is incremental as it focuses on resource compilation and adaptation.
This paper tackles the data scarcity problem in dialectal NLP by compiling a catalog of contemporary Basque dialectal resources, including online collections and standard-to-dialect adaptations, and provides a manually adapted parallel gold standard evaluation dataset for three Basque dialects.
Recent research on dialectal NLP has identified data scarcity as a primary limitation. To address this limitation, this paper presents a catalog of contemporary Basque dialectal data and resources, offering a systematic and comprehensive compilation of the dialectal data currently available in Basque. Two types of data sources have been distinguished: online data originally written in some dialect, and standard-to-dialect adapted data. The former includes all dialectal data that can be found online, such as news and radio sites, informal tweets, as well as online resources such as dictionaries, atlases, grammar rules, or videos. The latter consists of data that has been adapted from the standard variety to dialectal varieties, either manually or automatically. Regarding the manual adaptation, the test split of the XNLI Natural Language Inference dataset was manually adapted into three Basque dialects: Western, Central, and Navarrese-Lapurdian, yielding a high-quality parallel gold standard evaluation dataset. With respect to the automatic dialectal adaptation, the automatically adapted physical commonsense dataset (BasPhyCowest) underwent additional manual evaluation by native speakers to assess its quality and determine whether it could serve as a viable substitute for full manual adaptation (i.e., silver data creation).