A Large Self-Annotated Corpus for Sarcasm
This provides a large-scale resource for researchers and developers working on sarcasm detection in natural language processing, though it is incremental as it builds on existing dataset efforts.
The authors tackled the problem of limited data for sarcasm detection by introducing the Self-Annotated Reddit Corpus (SARC), which contains 1.3 million sarcastic statements, 10 times more than previous datasets, and includes non-sarcastic statements for balanced and unbalanced learning.
We introduce the Self-Annotated Reddit Corpus (SARC), a large corpus for sarcasm research and for training and evaluating systems for sarcasm detection. The corpus has 1.3 million sarcastic statements -- 10 times more than any previous dataset -- and many times more instances of non-sarcastic statements, allowing for learning in both balanced and unbalanced label regimes. Each statement is furthermore self-annotated -- sarcasm is labeled by the author, not an independent annotator -- and provided with user, topic, and conversation context. We evaluate the corpus for accuracy, construct benchmarks for sarcasm detection, and evaluate baseline methods.