The CL-SciSumm Shared Task 2018: Results and Key Insights
This work addresses the need for benchmark datasets and evaluation in scientific summarization for the computational linguistics community, but it is incremental as it builds on previous shared tasks.
The paper presents the results of the CL-SciSumm Shared Task 2018, which tackled scientific document summarization in computational linguistics using a dataset of 60 annotated paper sets, and compares participating systems using two evaluation metrics.
This overview describes the official results of the CL-SciSumm Shared Task 2018 -- the first medium-scale shared task on scientific document summarization in the computational linguistics (CL) domain. This year, the dataset comprised 60 annotated sets of citing and reference papers from the open access research papers in the CL domain. The Shared Task was organized as a part of the 41st Annual Conference of the Special Interest Group in Information Retrieval (SIGIR), held in Ann Arbor, USA in July 2018. We compare the participating systems in terms of two evaluation metrics. The annotated dataset and evaluation scripts can be accessed and used by the community from: \url{https://github.com/WING-NUS/scisumm-corpus}.