Unit Ball Model for Embedding Hierarchical Structures in the Complex Hyperbolic Space
This addresses representation learning for non-tree hierarchical data like taxonomies, offering a more flexible approach, though it is incremental as it builds on hyperbolic embeddings.
The authors tackled the problem of embedding hierarchical structures that do not match constant negative curvature by proposing embeddings in the complex hyperbolic space with variable curvature, showing significant improvements over hyperbolic models in experiments.
Learning the representation of data with hierarchical structures in the hyperbolic space attracts increasing attention in recent years. Due to the constant negative curvature, the hyperbolic space resembles tree metrics and captures the tree-like properties naturally, which enables the hyperbolic embeddings to improve over traditional Euclidean models. However, many real-world hierarchically structured data such as taxonomies and multitree networks have varying local structures and they are not trees, thus they do not ubiquitously match the constant curvature property of the hyperbolic space. To address this limitation of hyperbolic embeddings, we explore the complex hyperbolic space, which has the variable negative curvature, for representation learning. Specifically, we propose to learn the embeddings of hierarchically structured data in the unit ball model of the complex hyperbolic space. The unit ball model based embeddings have a more powerful representation capacity to capture a variety of hierarchical structures. Through experiments on synthetic and real-world data, we show that our approach improves over the hyperbolic embedding models significantly. We also explore the competence of complex hyperbolic geometry on the multitree structure and $1$-$N$ structure.