Fast Computation of Katz Index for Efficient Processing of Link Prediction Queries
This work addresses the challenge of slow network proximity computations for link prediction in large-scale data mining applications, offering incremental improvements in speed and accuracy.
The authors tackled the problem of efficiently computing Katz index for link prediction in large networks by proposing LRC-Katz, which outperforms the fastest existing method, Conjugate Gradient, across various parameters and improves query processing efficiency. They also introduced a modularity-based link prediction algorithm that significantly outperforms the state-of-the-art Katz method in experiments.
Network proximity computations are among the most common operations in various data mining applications, including link prediction and collaborative filtering. A common measure of network proximity is Katz index, which has been shown to be among the best-performing path-based link prediction algorithms. With the emergence of very large network databases, such proximity computations become an important part of query processing in these databases. Consequently, significant effort has been devoted to developing algorithms for efficient computation of Katz index between a given pair of nodes or between a query node and every other node in the network. Here, we present LRC-Katz, an algorithm based on indexing and low-rank correction to accelerate Katz index-based network proximity queries. Using a variety of very large real-world networks, we show that LRC-Katz outperforms the fastest existing method, Conjugate Gradient, for a wide range of parameter values. We also show that this acceleration in the computation of Katz index can be used to drastically improve the efficiency of processing link prediction queries in very large networks. Motivated by this observation, we propose a new link prediction algorithm that exploits modularity of networks that are encountered in practical applications. Our experimental results on the link prediction problem show that our modularity based algorithm significantly outperforms the state-of-the-art link prediction Katz method.