CLAILGMay 7, 2021

A Survey of Data Augmentation Approaches for NLP

arXiv:2105.03075v5980 citationsHas Code
Originality Synthesis-oriented
AI Analysis

This is an incremental work that provides a structured overview for researchers and practitioners in NLP, particularly in low-resource domains.

The paper presents a comprehensive survey of data augmentation methods for NLP, summarizing existing literature and highlighting current challenges to motivate future research.

Data augmentation has recently seen increased interest in NLP due to more work in low-resource domains, new tasks, and the popularity of large-scale neural networks that require large amounts of training data. Despite this recent upsurge, this area is still relatively underexplored, perhaps due to the challenges posed by the discrete nature of language data. In this paper, we present a comprehensive and unifying survey of data augmentation for NLP by summarizing the literature in a structured manner. We first introduce and motivate data augmentation for NLP, and then discuss major methodologically representative approaches. Next, we highlight techniques that are used for popular NLP applications and tasks. We conclude by outlining current challenges and directions for future research. Overall, our paper aims to clarify the landscape of existing literature in data augmentation for NLP and motivate additional work in this area. We also present a GitHub repository with a paper list that will be continuously updated at https://github.com/styfeng/DataAug4NLP

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes