Two Huge Title and Keyword Generation Corpora of Research Articles
This provides incremental resources for researchers working on automated text summarization and keyword generation tasks.
The authors tackled the need for large training corpora in text summarization and keyword generation by introducing two huge datasets, OAGSX with 34 million records for summarization and OAGKX with 23 million records for keyword generation, retrieved from the Open Academic Graph.
Recent developments in sequence-to-sequence learning with neural networks have considerably improved the quality of automatically generated text summaries and document keywords, stipulating the need for even bigger training corpora. Metadata of research articles are usually easy to find online and can be used to perform research on various tasks. In this paper, we introduce two huge datasets for text summarization (OAGSX) and keyword generation (OAGKX) research, containing 34 million and 23 million records, respectively. The data were retrieved from the Open Academic Graph which is a network of research profiles and publications. We carefully processed each record and also tried several extractive and abstractive methods of both tasks to create performance baselines for other researchers. We further illustrate the performance of those methods previewing their outputs. In the near future, we would like to apply topic modeling on the two sets to derive subsets of research articles from more specific disciplines.