论文标题
与时间信息控制的简洁和稳健的多代理通信
Succinct and Robust Multi-Agent Communication With Temporal Message Control
论文作者
论文摘要
最近的研究表明，引入代理之间的沟通可以显着改善合作多代理增强学习（MARL）的总体绩效。但是，现有的通信方案通常要求代理在可靠的通信渠道下在运行时交换过多的消息，从而阻碍其在许多现实情况下的实用性。在本文中，我们介绍\ textit {暂时消息控制}（TMC），这是一种简单而有效的方法，用于在MARL中实现简洁而强大的通信。 TMC应用了一种时间平滑技术来大大减少代理之间交换的信息量。实验表明，TMC可以显着减少代理间通信开销而不会影响准确性。此外，TMC表现出比在有损网络环境中现有方法相比，对传输损失的鲁棒性要好得多。
Recent studies have shown that introducing communication between agents can significantly improve overall performance in cooperative Multi-agent reinforcement learning (MARL). However, existing communication schemes often require agents to exchange an excessive number of messages at run-time under a reliable communication channel, which hinders its practicality in many real-world situations. In this paper, we present \textit{Temporal Message Control} (TMC), a simple yet effective approach for achieving succinct and robust communication in MARL. TMC applies a temporal smoothing technique to drastically reduce the amount of information exchanged between agents. Experiments show that TMC can significantly reduce inter-agent communication overhead without impacting accuracy. Furthermore, TMC demonstrates much better robustness against transmission loss than existing approaches in lossy networking environments.
