MEMLJul 10, 2016

Covariate Regularized Community Detection in Sparse Graphs

arXiv:1607.02675v464 citations
AI Analysis

This addresses the problem of incomplete clustering information in sparse networks for statisticians and network analysts, offering a novel approach that is incremental over prior dense-regime methods.

The paper tackles community detection in sparse graphs with node covariates by proposing an optimization framework that jointly uses network edges and covariates to improve clustering accuracy, demonstrating superior performance in simulations and real data.

In this paper, we investigate community detection in networks in the presence of node covariates. In many instances, covariates and networks individually only give a partial view of the cluster structure. One needs to jointly infer the full cluster structure by considering both. In statistics, an emerging body of work has been focused on combining information from both the edges in the network and the node covariates to infer community memberships. However, so far the theoretical guarantees have been established in the dense regime, where the network can lead to perfect clustering under a broad parameter regime, and hence the role of covariates is often not clear. In this paper, we examine sparse networks in conjunction with finite dimensional sub-gaussian mixtures as covariates under moderate separation conditions. In this setting each individual source can only cluster a non-vanishing fraction of nodes correctly. We propose a simple optimization framework which provably improves clustering accuracy when the two sources carry partial information about the cluster memberships, and hence perform poorly on their own. Our optimization problem can be solved using scalable convex optimization algorithms. Using a variety of simulated and real data examples, we show that the proposed method outperforms other existing methodology.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes