Semantically Constrained Multilayer Annotation: The Case of Coreference
This work addresses annotation inconsistencies in coreference resolution for NLP researchers, but it appears incremental as it builds on existing foundational layers.
The authors tackled the challenge of inconsistent coreference annotation by proposing a scheme built on top of Universal Conceptual Cognitive Annotation, using predicate-argument structure as a basis for mentions. They conducted a pilot study to compare it with other schemes, but no concrete numbers or results were provided.
We propose a coreference annotation scheme as a layer on top of the Universal Conceptual Cognitive Annotation foundational layer, treating units in predicate-argument structure as a basis for entity and event mentions. We argue that this allows coreference annotators to sidestep some of the challenges faced in other schemes, which do not enforce consistency with predicate-argument structure and vary widely in what kinds of mentions they annotate and how. The proposed approach is examined with a pilot annotation study and compared with annotations from other schemes.