CLOct 16, 2024

Comparative Analysis of Extrinsic Factors for NER in French

arXiv:2410.12750v2h-index: 6
Originality Synthesis-oriented
AI Analysis

This work addresses the challenge of limited data availability for NER in non-English languages like French, offering incremental improvements through combined techniques.

The paper tackled the problem of improving named entity recognition (NER) for French with limited data by exploring factors like model structure, annotation schemes, and data augmentation, achieving an F1 score increase from 62.41 to 79.39.

Named entity recognition (NER) is a crucial task that aims to identify structured information, which is often replete with complex, technical terms and a high degree of variability. Accurate and reliable NER can facilitate the extraction and analysis of important information. However, NER for other than English is challenging due to limited data availability, as the high expertise, time, and expenses are required to annotate its data. In this paper, by using the limited data, we explore various factors including model structure, corpus annotation scheme and data augmentation techniques to improve the performance of a NER model for French. Our experiments demonstrate that these approaches can significantly improve the model's F1 score from original CRF score of 62.41 to 79.39. Our findings suggest that considering different extrinsic factors and combining these techniques is a promising approach for improving NER performance where the size of data is limited.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes