CLFeb 22, 2024

LLM-DA: Data Augmentation via Large Language Models for Few-Shot Named Entity Recognition

arXiv:2402.14568v128 citationsh-index: 40
Originality Incremental advance
AI Analysis

This addresses the challenge of data scarcity in NER tasks, offering a domain-specific solution that is incremental in nature.

The paper tackles the problem of few-shot named entity recognition by proposing LLM-DA, a data augmentation technique using large language models, which improves NER model performance with limited data as shown in experiments.

Despite the impressive capabilities of large language models (LLMs), their performance on information extraction tasks is still not entirely satisfactory. However, their remarkable rewriting capabilities and extensive world knowledge offer valuable insights to improve these tasks. In this paper, we propose $LLM-DA$, a novel data augmentation technique based on LLMs for the few-shot NER task. To overcome the limitations of existing data augmentation methods that compromise semantic integrity and address the uncertainty inherent in LLM-generated text, we leverage the distinctive characteristics of the NER task by augmenting the original data at both the contextual and entity levels. Our approach involves employing 14 contextual rewriting strategies, designing entity replacements of the same type, and incorporating noise injection to enhance robustness. Extensive experiments demonstrate the effectiveness of our approach in enhancing NER model performance with limited data. Furthermore, additional analyses provide further evidence supporting the assertion that the quality of the data we generate surpasses that of other existing methods.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes