Dynamic Trust-Aware Sparse Communication Topology for LLM-Based Multi-Agent Consensus
基于动态信任感知的稀疏通信拓扑用于基于LLM的多智能体共识
Wanshuang Gou, Zihan Liu
AI总结 提出DySCo动态稀疏共识机制,通过信任感知的边选择降低通信开销并保持共识质量。
详情
- Comments
- 11 pages, 3 figures, 5 tables
大型语言模型驱动的多智能体系统通过多轮讨论、角色专业化和交叉验证增强了复杂推理任务的可靠性。然而,现有的多智能体辩论和协作框架通常采用全连接通信,导致消息数量、令牌成本和端到端延迟随智能体数量近似二次增长;尽管固定稀疏拓扑减少了开销,但它们无法适应不同任务实例或中间推理状态,容易保留低价值交互或丢失关键的纠错信息。针对这一问题,本文提出了DySCo(动态稀疏共识),一种动态信任感知的稀疏共识机制。在每一轮推理中,DySCo基于智能体可靠性、答案分歧和任务相关性估计通信边的价值,并在预算约束下选择少量高价值边进行消息交换;然后通过动态信任权重聚合不同智能体的答案,并在共识稳定后提前终止讨论。该机制用按需通信替代通用广播,从而在保留关键交叉验证信息的同时降低通信开销。我们进一步给出了通信复杂度和共识稳定性的分析,并在数学推理、逻辑推理和事实问答任务上评估了DySCo的性能。
Large language model-driven multi-agent systems enhance the reliability of complex reasoning tasks through multi-round deliberation, role specialization, and cross-validation. However, existing multi-agent debate and collaboration frameworks typically adopt fully connected communication, causing the number of messages, token costs, and end-to-end latency to grow approximately quadratically with the number of agents; although fixed sparse topologies reduce overhead, they cannot adapt communication relationships to different task instances or intermediate reasoning states, making them prone either to preserving low-value interactions or to losing critical error-correction information. To address this problem, this paper proposes DySCo (Dynamic Sparse Consensus), a dynamic trust-aware sparse consensus mechanism. In each round of reasoning, DySCo estimates the value of communication edges based on agent reliability, answer divergence, and task relevance, and selects a small number of high-value edges for message exchange under budget constraints; it then aggregates the answers of different agents through dynamic trust weights and terminates the discussion early once consensus stabilizes. This mechanism replaces universal broadcasting with on-demand communication, thereby reducing communication overhead while preserving essential cross-validation information. We further present analyses of communication complexity and consensus stability, and evaluate the performance of DySCo on mathematical reasoning, logical reasoning, and factual question-answering tasks.