CLMay 31, 2019

Improving the Similarity Measure of Determinantal Point Processes for Extractive Multi-Document Summarization

arXiv:1906.00072v11114 citations
Originality Incremental advance
AI Analysis

This work addresses extractive summarization for documents with redundant, lexically diverse content from multiple authors, representing an incremental improvement.

The paper tackled redundancy and data scarcity in multi-document summarization by introducing a novel similarity measure for determinantal point processes, achieving competitive performance that outperforms strong baselines on benchmark datasets.

The most important obstacles facing multi-document summarization include excessive redundancy in source descriptions and the looming shortage of training data. These obstacles prevent encoder-decoder models from being used directly, but optimization-based methods such as determinantal point processes (DPPs) are known to handle them well. In this paper we seek to strengthen a DPP-based method for extractive multi-document summarization by presenting a novel similarity measure inspired by capsule networks. The approach measures redundancy between a pair of sentences based on surface form and semantic information. We show that our DPP system with improved similarity measure performs competitively, outperforming strong summarization baselines on benchmark datasets. Our findings are particularly meaningful for summarizing documents created by multiple authors containing redundant yet lexically diverse expressions.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes