Dynamic Generation of Multi-LLM Agents Communication Topologies with Graph Diffusion Models
This addresses the problem of inefficient or static communication in multi-LLM agent systems, offering a novel solution for researchers and practitioners in AI and multi-agent systems, though it appears incremental as it builds on graph diffusion models.
The paper tackles the challenge of designing optimal communication topologies for multi-agent systems driven by large language models (LLMs), introducing a generative framework called Guided Topology Diffusion (GTD) that dynamically synthesizes task-adaptive topologies, significantly outperforming existing methods in benchmarks.
The efficiency of multi-agent systems driven by large language models (LLMs) largely hinges on their communication topology. However, designing an optimal topology is a non-trivial challenge, as it requires balancing competing objectives such as task performance, communication cost, and robustness. Existing frameworks often rely on static or hand-crafted topologies, which inherently fail to adapt to diverse task requirements, leading to either excessive token consumption for simple problems or performance bottlenecks for complex ones. To address this challenge, we introduce a novel generative framework called \textit{Guided Topology Diffusion (GTD)}. Inspired by conditional discrete graph diffusion models, GTD formulates topology synthesis as an iterative construction process. At each step, the generation is steered by a lightweight proxy model that predicts multi-objective rewards (e.g., accuracy, utility, cost), enabling real-time, gradient-free optimization towards task-adaptive topologies. This iterative, guided synthesis process distinguishes GTD from single-step generative frameworks, enabling it to better navigate complex design trade-offs. We validated GTD across multiple benchmarks, and experiments show that this framework can generate highly task-adaptive, sparse, and efficient communication topologies, significantly outperforming existing methods in LLM agent collaboration.