KagNet: Knowledge-Aware Graph Networks for Commonsense Reasoning
This addresses the problem of enabling machines to perform human-like commonsense reasoning, which is incremental as it builds on existing graph-based and BERT-based methods.
The authors tackled commonsense reasoning by proposing KagNet, a framework that integrates external knowledge graphs like ConceptNet to answer commonsense questions, achieving state-of-the-art performance on the CommonsenseQA dataset.
Commonsense reasoning aims to empower machines with the human ability to make presumptions about ordinary situations in our daily life. In this paper, we propose a textual inference framework for answering commonsense questions, which effectively utilizes external, structured commonsense knowledge graphs to perform explainable inferences. The framework first grounds a question-answer pair from the semantic space to the knowledge-based symbolic space as a schema graph, a related sub-graph of external knowledge graphs. It represents schema graphs with a novel knowledge-aware graph network module named KagNet, and finally scores answers with graph representations. Our model is based on graph convolutional networks and LSTMs, with a hierarchical path-based attention mechanism. The intermediate attention scores make it transparent and interpretable, which thus produce trustworthy inferences. Using ConceptNet as the only external resource for Bert-based models, we achieved state-of-the-art performance on the CommonsenseQA, a large-scale dataset for commonsense reasoning.