Graph Distance as Surprise: Free Energy Minimization in Knowledge Graph Reasoning
This is an incremental work-in-progress that explores extending surprise minimization concepts to knowledge graphs for potential applications in AI reasoning.
The paper tackles the problem of knowledge graph reasoning by proposing that surprise minimization, based on graph distance, can guide it, connecting the Free Energy Principle from neuroscience to KG systems as a framework for agents.
In this work, we propose that reasoning in knowledge graph (KG) networks can be guided by surprise minimization. Entities that are close in graph distance will have lower surprise than those farther apart. This connects the Free Energy Principle (FEP) from neuroscience to KG systems, where the KG serves as the agent's generative model. We formalize surprise using the shortest-path distance in directed graphs and provide a framework for KG-based agents. Graph distance appears in graph neural networks as message passing depth and in model-based reinforcement learning as world model trajectories. This work-in-progress study explores whether distance-based surprise can extend recent work showing that syntax minimizes surprise and free energy via tree structures.