AILGApr 10, 2024

A Foundation Model for Zero-shot Logical Query Reasoning

DeepMind
arXiv:2404.07198v218 citationsh-index: 25NIPS
Originality Highly original
AI Analysis

This addresses the bottleneck of deploying logical reasoning models across diverse knowledge graphs, offering a scalable solution for AI applications requiring flexible query answering.

The paper tackles the problem of complex logical query answering on knowledge graphs by introducing UltraQuery, a foundation model that enables zero-shot reasoning on any KG without extensive retraining, achieving state-of-the-art performance on 15 out of 23 datasets.

Complex logical query answering (CLQA) in knowledge graphs (KGs) goes beyond simple KG completion and aims at answering compositional queries comprised of multiple projections and logical operations. Existing CLQA methods that learn parameters bound to certain entity or relation vocabularies can only be applied to the graph they are trained on which requires substantial training time before being deployed on a new graph. Here we present UltraQuery, the first foundation model for inductive reasoning that can zero-shot answer logical queries on any KG. The core idea of UltraQuery is to derive both projections and logical operations as vocabulary-independent functions which generalize to new entities and relations in any KG. With the projection operation initialized from a pre-trained inductive KG reasoning model, UltraQuery can solve CLQA on any KG after finetuning on a single dataset. Experimenting on 23 datasets, UltraQuery in the zero-shot inference mode shows competitive or better query answering performance than best available baselines and sets a new state of the art on 15 of them.

Code Implementations2 repos
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes