MLLGSIOCSTFeb 28, 2024

Inferring Dynamic Networks from Marginals with Iterative Proportional Fitting

arXiv:2402.18697v24 citationsh-index: 149ICML
AI Analysis

This work addresses a common network inference challenge for researchers dealing with incomplete temporal data, offering theoretical grounding and practical solutions, though it is incremental in building on existing IPF methods.

The paper tackles the problem of inferring dynamic networks from aggregated adjacency matrices and time-varying marginals by establishing a generative model where iterative proportional fitting (IPF) provides maximum likelihood estimates, and introduces a modified algorithm to ensure convergence on sparse data, with experiments showing improved performance on synthetic and real-world datasets.

A common network inference problem, arising from real-world data constraints, is how to infer a dynamic network from its time-aggregated adjacency matrix and time-varying marginals (i.e., row and column sums). Prior approaches to this problem have repurposed the classic iterative proportional fitting (IPF) procedure, also known as Sinkhorn's algorithm, with promising empirical results. However, the statistical foundation for using IPF has not been well understood: under what settings does IPF provide principled estimation of a dynamic network from its marginals, and how well does it estimate the network? In this work, we establish such a setting, by identifying a generative network model whose maximum likelihood estimates are recovered by IPF. Our model both reveals implicit assumptions on the use of IPF in such settings and enables new analyses, such as structure-dependent error bounds on IPF's parameter estimates. When IPF fails to converge on sparse network data, we introduce a principled algorithm that guarantees IPF converges under minimal changes to the network structure. Finally, we conduct experiments with synthetic and real-world data, which demonstrate the practical value of our theoretical and algorithmic contributions.

Code Implementations1 repo
Foundations

The foundational work for this paper's niche, ranked by how specifically the neighbourhood builds on it — not by global fame.

Your Notes