CLApr 27, 2022

Propose-and-Refine: A Two-Stage Set Prediction Network for Nested Named Entity Recognition

arXiv:2204.12732v211 citationsh-index: 28
Originality Incremental advance
AI Analysis

This addresses nested NER, a fundamental NLP task, with incremental improvements over span-based methods by handling long entities and entity relationships.

The paper tackles nested named entity recognition by proposing a two-stage set prediction network that generates coarse entity proposals and refines them with contextual interactions, achieving state-of-the-art performance on four nested and one flat NER datasets.

Nested named entity recognition (nested NER) is a fundamental task in natural language processing. Various span-based methods have been proposed to detect nested entities with span representations. However, span-based methods do not consider the relationship between a span and other entities or phrases, which is helpful in the NER task. Besides, span-based methods have trouble predicting long entities due to limited span enumeration length. To mitigate these issues, we present the Propose-and-Refine Network (PnRNet), a two-stage set prediction network for nested NER. In the propose stage, we use a span-based predictor to generate some coarse entity predictions as entity proposals. In the refine stage, proposals interact with each other, and richer contextual information is incorporated into the proposal representations. The refined proposal representations are used to re-predict entity boundaries and classes. In this way, errors in coarse proposals can be eliminated, and the boundary prediction is no longer constrained by the span enumeration length limitation. Additionally, we build multi-scale sentence representations, which better model the hierarchical structure of sentences and provide richer contextual information than token-level representations. Experiments show that PnRNet achieves state-of-the-art performance on four nested NER datasets and one flat NER dataset.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes