The Dual PC Algorithm and the Role of Gaussianity for Structure Learning of Bayesian Networks
This work addresses the problem of efficient structure learning in Bayesian networks for applications in complex data analysis, representing an incremental improvement over existing methods.
The authors tackled the computational challenge of learning Bayesian network structures from observational data by introducing the dual PC algorithm, which leverages inverse covariance relationships and block matrix inversions to perform conditional independence tests more efficiently. Simulation results showed that the dual PC algorithm outperforms the classic PC algorithm in both run time and accuracy in recovering network structures, even under non-Gaussian conditions.
Learning the graphical structure of Bayesian networks is key to describing data-generating mechanisms in many complex applications but poses considerable computational challenges. Observational data can only identify the equivalence class of the directed acyclic graph underlying a Bayesian network model, and a variety of methods exist to tackle the problem. Under certain assumptions, the popular PC algorithm can consistently recover the correct equivalence class by reverse-engineering the conditional independence (CI) relationships holding in the variable distribution. The dual PC algorithm is a novel scheme to carry out the CI tests within the PC algorithm by leveraging the inverse relationship between covariance and precision matrices. By exploiting block matrix inversions we can also perform tests on partial correlations of complementary (or dual) conditioning sets. The multiple CI tests of the dual PC algorithm proceed by first considering marginal and full-order CI relationships and progressively moving to central-order ones. Simulation studies show that the dual PC algorithm outperforms the classic PC algorithm both in terms of run time and in recovering the underlying network structure, even in the presence of deviations from Gaussianity. Additionally, we show that the dual PC algorithm applies for Gaussian copula models, and demonstrate its performance in that setting.