CLJan 26, 2023

Paraphrase Acquisition from Image Captions

arXiv:2301.11030v2267 citationsh-index: 53
Originality Synthesis-oriented
AI Analysis

This work addresses the need for paraphrase datasets in natural language processing, though it is incremental as it builds on existing resources like Wikipedia captions.

The paper tackled the problem of acquiring paraphrases by using image captions from the Web as an underutilized resource, resulting in the creation of the Wikipedia-IPC dataset and analysis showing high reliability in identifying paraphrase styles through characteristic maps.

We propose to use image captions from the Web as a previously underutilized resource for paraphrases (i.e., texts with the same "message") and to create and analyze a corresponding dataset. When an image is reused on the Web, an original caption is often assigned. We hypothesize that different captions for the same image naturally form a set of mutual paraphrases. To demonstrate the suitability of this idea, we analyze captions in the English Wikipedia, where editors frequently relabel the same image for different articles. The paper introduces the underlying mining technology, the resulting Wikipedia-IPC dataset, and compares known paraphrase corpora with respect to their syntactic and semantic paraphrase similarity to our new resource. In this context, we introduce characteristic maps along the two similarity dimensions to identify the style of paraphrases coming from different sources. An annotation study demonstrates the high reliability of the algorithmically determined characteristic maps.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes