CLAISep 22, 2021

HyperExpan: Taxonomy Expansion with Hyperbolic Representation Learning

arXiv:2109.10500v1664 citations
Originality Incremental advance
AI Analysis

This addresses the coverage issue in taxonomies for applications relying on hierarchical data, but it is incremental as it builds on prior embedding methods by switching to hyperbolic space.

The paper tackles the problem of limited coverage in manually curated taxonomies by proposing HyperExpan, an algorithm that expands taxonomies using hyperbolic representation learning, achieving state-of-the-art performance on benchmarks.

Taxonomies are valuable resources for many applications, but the limited coverage due to the expensive manual curation process hinders their general applicability. Prior works attempt to automatically expand existing taxonomies to improve their coverage by learning concept embeddings in Euclidean space, while taxonomies, inherently hierarchical, more naturally align with the geometric properties of a hyperbolic space. In this paper, we present HyperExpan, a taxonomy expansion algorithm that seeks to preserve the structure of a taxonomy in a more expressive hyperbolic embedding space and learn to represent concepts and their relations with a Hyperbolic Graph Neural Network (HGNN). Specifically, HyperExpan leverages position embeddings to exploit the structure of the existing taxonomies, and characterizes the concept profile information to support the inference on unseen concepts during training. Experiments show that our proposed HyperExpan outperforms baseline models with representation learning in a Euclidean feature space and achieves state-of-the-art performance on the taxonomy expansion benchmarks.

Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes