CLDec 8, 2021

Prompt-based Zero-shot Relation Extraction with Semantic Knowledge Augmentation

arXiv:2112.04539v385 citations
Originality Incremental advance
AI Analysis

This addresses the problem of extracting unseen relations in NLP for applications like knowledge base construction, though it is incremental as it builds on existing prompt-based and knowledge-augmented approaches.

The paper tackles zero-shot relation extraction by proposing a prompt-based model with semantic knowledge augmentation (ZS-SKA) to recognize unseen relations, achieving improved performance on three public datasets compared to other methods.

In relation triplet extraction (RTE), recognizing unseen relations for which there are no training instances is a challenging task. Efforts have been made to recognize unseen relations based on question-answering models or relation descriptions. However, these approaches miss the semantic information about connections between seen and unseen relations. In this paper, We propose a prompt-based model with semantic knowledge augmentation (ZS-SKA) to recognize unseen relations under the zero-shot setting. We present a new word-level analogy-based sentence translation rule and generate augmented instances with unseen relations from instances with seen relations using that new rule. We design prompts with weighted virtual label construction based on an external knowledge graph to integrate semantic knowledge information learned from seen relations. Instead of using the actual label sets in the prompt template, we construct weighted virtual label words. We learn the representations of both seen and unseen relations with augmented instances and prompts. We then calculate the distance between the generated representations using prototypical networks to predict unseen relations. Extensive experiments conducted on three public datasets FewRel, Wiki-ZSL, and NYT, show that ZS-SKA outperforms other methods under zero-shot setting. Results also demonstrate the effectiveness and robustness of ZS-SKA.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes