A Multivariate Hawkes Process with Gaps in Observations
This addresses the challenge of inferring causal relationships in networks with incomplete data, which is incremental as it extends existing Hawkes process methods to handle gaps.
The paper tackles the problem of learning hidden directional relationships among entities in a network from intermittent observations of activities, using a multivariate Hawkes process with gaps (MHPG). It shows through simulations that robust recovery is possible even with sparse observations (e.g., 10-30%), provided observed intervals are appropriately chosen.
Given a collection of entities (or nodes) in a network and our intermittent observations of activities from each entity, an important problem is to learn the hidden edges depicting directional relationships among these entities. Here, we study causal relationships (excitations) that are realized by a multivariate Hawkes process. The multivariate Hawkes process (MHP) and its variations (spatio-temporal point processes) have been used to study contagion in earthquakes, crimes, neural spiking activities, the stock and foreign exchange markets, etc. In this paper, we consider the multivariate Hawkes process with gaps in observations (MHPG). We propose a variational problem for detecting sparsely hidden relationships with a multivariate Hawkes process that takes into account the gaps from each entity. We bypass the problem of dealing with a large amount of missing events by introducing a small number of unknown boundary conditions. In the case where our observations are sparse (e.g. from 10% to 30%), we show through numerical simulations that robust recovery with MHPG is still possible even if the lengths of the observed intervals are small but they are chosen accordingly. The numerical results also show that the knowledge of gaps and imposing the right boundary conditions are very crucial in discovering the underlying patterns and hidden relationships.