CLAug 27, 2022

A Multi-Format Transfer Learning Model for Event Argument Extraction via Variational Information Bottleneck

arXiv:2208.13017v3585 citationsh-index: 70
Originality Incremental advance
AI Analysis

This addresses the challenge of high labeling costs and format variability in EAE for natural language processing applications, representing an incremental improvement over existing methods.

The paper tackles the problem of event argument extraction (EAE) by proposing a multi-format transfer learning model with variational information bottleneck to adapt to new datasets with different annotation formats, achieving new state-of-the-art performance on three benchmark datasets.

Event argument extraction (EAE) aims to extract arguments with given roles from texts, which have been widely studied in natural language processing. Most previous works have achieved good performance in specific EAE datasets with dedicated neural architectures. Whereas, these architectures are usually difficult to adapt to new datasets/scenarios with various annotation schemas or formats. Furthermore, they rely on large-scale labeled data for training, which is unavailable due to the high labelling cost in most cases. In this paper, we propose a multi-format transfer learning model with variational information bottleneck, which makes use of the information especially the common knowledge in existing datasets for EAE in new datasets. Specifically, we introduce a shared-specific prompt framework to learn both format-shared and format-specific knowledge from datasets with different formats. In order to further absorb the common knowledge for EAE and eliminate the irrelevant noise, we integrate variational information bottleneck into our architecture to refine the shared representation. We conduct extensive experiments on three benchmark datasets, and obtain new state-of-the-art performance on EAE.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes