IRAICLJul 25, 2017

Structural Regularities in Text-based Entity Vector Spaces

arXiv:1707.07930v17 citations
Originality Synthesis-oriented
AI Analysis

This work addresses the problem of improving entity retrieval for tasks like expert finding by analyzing structural regularities, though it is incremental as it compares existing methods on a specific domain.

The study investigated how unsupervised text-based entity vector spaces capture structural regularities like organizational committees and co-author graphs, finding that neural methods like doc2vec and SERT outperformed others in clustering and relation encoding.

Entity retrieval is the task of finding entities such as people or products in response to a query, based solely on the textual documents they are associated with. Recent semantic entity retrieval algorithms represent queries and experts in finite-dimensional vector spaces, where both are constructed from text sequences. We investigate entity vector spaces and the degree to which they capture structural regularities. Such vector spaces are constructed in an unsupervised manner without explicit information about structural aspects. For concreteness, we address these questions for a specific type of entity: experts in the context of expert finding. We discover how clusterings of experts correspond to committees in organizations, the ability of expert representations to encode the co-author graph, and the degree to which they encode academic rank. We compare latent, continuous representations created using methods based on distributional semantics (LSI), topic models (LDA) and neural networks (word2vec, doc2vec, SERT). Vector spaces created using neural methods, such as doc2vec and SERT, systematically perform better at clustering than LSI, LDA and word2vec. When it comes to encoding entity relations, SERT performs best.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes