To trust or not to trust: Attention-based Trust Management for LLM Multi-Agent Systems
Addresses a critical vulnerability in LLM multi-agent systems by providing a principled, interpretable trust management framework.
LLM-based multi-agent systems are vulnerable to unreliable messages because they treat all inputs equally. The authors propose a trust management system using an attention-based trust score (A-Trust) that evaluates messages across six trust dimensions, significantly improving robustness against malicious inputs.
Large Language Model-based Multi-Agent Systems (LLM-MAS) have demonstrated strong capabilities in solving complex tasks but remain vulnerable when agents receive unreliable messages. This vulnerability stems from a fundamental gap: LLM agents treat all incoming messages equally without evaluating their trustworthiness. While some existing studies approach trustworthiness, they focus on a single type of harmfulness rather than analyze it in a holistic approach from multiple trustworthiness perspectives. We address this gap by proposing a comprehensive definition of trustworthiness inspired by human communication theory (Grice, 1975). Our definition identifies six orthogonal trust dimensions that provide interpretable measures of trustworthiness. Building on this definition, we introduce the Attention Trust Score (A -Trust), a lightweight, attention-based method for evaluating the trustworthiness of messages. We then develop a principled trust management system (TMS) for LLM -MAS that supports both message-level and agent-level trust assessments. Experiments across diverse multi-agent settings and tasks demonstrate that our TMS significantly improves robustness against malicious inputs.