Big Data and Cross-Document Coreference Resolution: Current State and Future Opportunities
This is an incremental survey paper that addresses the problem of scaling CDCR for researchers and practitioners dealing with big data in information extraction.
The paper reviews the current state-of-the-art in Cross-Document Coreference Resolution (CDCR), a key task for extracting actionable intelligence from large datasets, and assesses existing tools and techniques while highlighting big data challenges such as scaling to peta-/tera-byte datasets.
Information Extraction (IE) is the task of automatically extracting structured information from unstructured/semi-structured machine-readable documents. Among various IE tasks, extracting actionable intelligence from ever-increasing amount of data depends critically upon Cross-Document Coreference Resolution (CDCR) - the task of identifying entity mentions across multiple documents that refer to the same underlying entity. Recently, document datasets of the order of peta-/tera-bytes has raised many challenges for performing effective CDCR such as scaling to large numbers of mentions and limited representational power. The problem of analysing such datasets is called "big data". The aim of this paper is to provide readers with an understanding of the central concepts, subtasks, and the current state-of-the-art in CDCR process. We provide assessment of existing tools/techniques for CDCR subtasks and highlight big data challenges in each of them to help readers identify important and outstanding issues for further investigation. Finally, we provide concluding remarks and discuss possible directions for future work.