CLAIOct 18, 2023

Multi-view Contrastive Learning for Entity Typing over Knowledge Graphs

arXiv:2310.12008v1132 citationsh-index: 7
Originality Incremental advance
AI Analysis

This addresses the challenge of inferring entity types in knowledge graphs, which is incremental by incorporating cluster-based semantics.

The paper tackles the problem of knowledge graph entity typing by introducing a multi-view contrastive learning method that incorporates coarse-grained type clusters, achieving strong performance compared to state-of-the-art approaches.

Knowledge graph entity typing (KGET) aims at inferring plausible types of entities in knowledge graphs. Existing approaches to KGET focus on how to better encode the knowledge provided by the neighbors and types of an entity into its representation. However, they ignore the semantic knowledge provided by the way in which types can be clustered together. In this paper, we propose a novel method called Multi-view Contrastive Learning for knowledge graph Entity Typing (MCLET), which effectively encodes the coarse-grained knowledge provided by clusters into entity and type embeddings. MCLET is composed of three modules: i) Multi-view Generation and Encoder module, which encodes structured information from entity-type, entity-cluster and cluster-type views; ii) Cross-view Contrastive Learning module, which encourages different views to collaboratively improve view-specific representations of entities and types; iii) Entity Typing Prediction module, which integrates multi-head attention and a Mixture-of-Experts strategy to infer missing entity types. Extensive experiments show the strong performance of MCLET compared to the state-of-the-art

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes