The Logical Expressiveness of Topological Neural Networks
For researchers in graph representation learning, this provides a precise logical characterization of TNN expressiveness, extending the Weisfeiler-Leman hierarchy to higher-order topological structures.
The paper establishes a logical expressiveness theory for topological neural networks (TNNs) by proving that the k-CCWL test is equivalent to topological counting logic TC_{k+2} and the topological (k+2)-pebble game, characterizing which binary classifiers TNNs can represent.
Graph neural networks (GNNs) are the standard for learning on graphs, yet they have limited expressive power, often expressed in terms of the Weisfeiler-Leman (WL) hierarchy or within the framework of first-order logic. In this context, topological neural networks (TNNs) have recently emerged as a promising alternative for graph representation learning. By incorporating higher-order relational structures into message-passing schemes, TNNs offer higher representational power than traditional GNNs. However, a fundamental question remains open: what is the logical expressiveness of TNNs? Answering this allows us to characterize precisely which binary classifiers TNNs can represent. In this paper, we address this question by analyzing isomorphism tests derived from the underlying mechanisms of general TNNs. We introduce and investigate the power of higher-order variants of WL-based tests for combinatorial complexes, called $k$-CCWL test. In addition, we introduce the topological counting logic (TC$_k$), an extension of standard counting logic featuring a novel pairwise counting quantifier $ \exists^{N}(x_i,x_j)\, φ(x_i,x_j), $ which explicitly quantifies pairs $(x_i, x_j)$ satisfying property $φ$. We rigorously prove the exact equivalence: $ \text{k-CCWL} \equiv \text{TC}_{k{+}2} \equiv \text{Topological }(k{+}2)\text{-pebble game}.$ These results establish a logical expressiveness theory for TNNs.