CLIRNov 24, 2018

HCqa: Hybrid and Complex Question Answering on Textual Corpus and Knowledge Graph

arXiv:1811.10986v55 citationsHas Code
Originality Highly original
AI Analysis

This addresses a limitation in QA systems for users needing answers to complex, multi-part questions from hybrid data sources, representing a novel method rather than an incremental improvement.

The paper tackles the problem of answering complex questions that require integrating knowledge from both textual corpora and knowledge graphs, introducing HCqa, which decomposes questions, extracts relations, and aggregates answers, achieving superior accuracy in relation extraction and federation tasks.

Question Answering (QA) systems provide easy access to the vast amount of knowledge without having to know the underlying complex structure of the knowledge. The research community has provided ad hoc solutions to the key QA tasks, including named entity recognition and disambiguation, relation extraction and query building. Furthermore, some have integrated and composed these components to implement many tasks automatically and efficiently. However, in general, the existing solutions are limited to simple and short questions and still do not address complex questions composed of several sub-questions. Exploiting the answer to complex questions is further challenged if it requires integrating knowledge from unstructured data sources, i.e., textual corpus, as well as structured data sources, i.e., knowledge graphs. In this paper, an approach (HCqa) is introduced for dealing with complex questions requiring federating knowledge from a hybrid of heterogeneous data sources (structured and unstructured). We contribute in developing (i) a decomposition mechanism which extracts sub-questions from potentially long and complex input questions, (ii) a novel comprehensive schema, first of its kind, for extracting and annotating relations, and (iii) an approach for executing and aggregating the answers of sub-questions. The evaluation of HCqa showed a superior accuracy in the fundamental tasks, such as relation extraction, as well as the federation task.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes