CLNov 13, 2024

Are Triggers Needed for Document-Level Event Extraction?

CMU
arXiv:2411.08708v21 citationsh-index: 18TACL
Originality Incremental advance
AI Analysis

This work addresses the role of triggers in the challenging and less-studied domain of document-level event extraction, providing insights for researchers and practitioners in NLP.

The paper investigates whether triggers are necessary for document-level event extraction, finding that their usefulness depends on dataset characteristics and task-specific information, and that even random triggers can aid prompt-based in-context learning.

Most existing work on event extraction has focused on sentence-level texts and presumes the identification of a trigger-span -- a word or phrase in the input that evokes the occurrence of an event of interest. Event arguments are then extracted with respect to the trigger. Indeed, triggers are treated as integral to, and trigger detection as an essential component of, event extraction. In this paper, we provide the first investigation of the role of triggers for the more difficult and much less studied task of document-level event extraction. We analyze their usefulness in multiple end-to-end and pipelined transformer-based event extraction models for three document-level event extraction datasets, measuring performance using triggers of varying quality (human-annotated, LLM-generated, keyword-based, and random). We find that whether or not systems benefit from explicitly extracting triggers depends both on dataset characteristics (i.e. the typical number of events per document) and task-specific information available during extraction (i.e. natural language event schemas). Perhaps surprisingly, we also observe that the mere existence of triggers in the input, even random ones, is important for prompt-based in-context learning approaches to the task.

Code Implementations2 repos
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes