论文标题

6G IN-X子网络中动态资源管理的多代理增强学习

Multi-agent Reinforcement Learning for Dynamic Resource Management in 6G in-X Subnetworks

论文作者

Du, Xiao, Wang, Ting, Feng, Qiang, Ye, Chenhui, Tao, Tao, Shi, Yuanming, Chen, Mingsong

论文摘要

6G网络启用了子网范围的进化,从而产生了“子网网络”。但是,由于无线子网的动态移动性,求职者内部和填充工作的数据传输将不可避免地互相干扰,这对无线电资源管理构成了巨大挑战。此外,大多数现有方法都需要子网之间的瞬时通道增益,这通常很难收集。为了解决这些问题,在本文中,我们提出了一种新型的有效的智能无线电资源管理方法,使用多代理深入强化学习(MARL),它在每个渠道上只需要接收的功率总和,即接收到的电源总和,而不是频道增长。但是,直接将单个干扰与RSSI分开是几乎不可能的事情。为此,我们进一步提出了一种名为GA-NET的新型MARL体系结构,该建筑集成了一个硬注意层,以模拟基于RSSI基于RSSI的subnetwork关系的重要性分布,并排除了不相关的子网络的影响,并将图形注意力网络与多头注意力层一起使用,以确切的特征和计算其权重,从而影响单独的透视。实验结果证明,我们提出的框架在各个方面都显着优于基于MARL的方法。

The 6G network enables a subnetwork-wide evolution, resulting in a "network of subnetworks". However, due to the dynamic mobility of wireless subnetworks, the data transmission of intra-subnetwork and inter-subnetwork will inevitably interfere with each other, which poses a great challenge to radio resource management. Moreover, most of the existing approaches require the instantaneous channel gain between subnetworks, which are usually difficult to be collected. To tackle these issues, in this paper we propose a novel effective intelligent radio resource management method using multi-agent deep reinforcement learning (MARL), which only needs the sum of received power, named received signal strength indicator (RSSI), on each channel instead of channel gains. However, to directly separate individual interference from RSSI is an almost impossible thing. To this end, we further propose a novel MARL architecture, named GA-Net, which integrates a hard attention layer to model the importance distribution of inter-subnetwork relationships based on RSSI and exclude the impact of unrelated subnetworks, and employs a graph attention network with a multi-head attention layer to exact the features and calculate their weights that will impact individual throughput. Experimental results prove that our proposed framework significantly outperforms both traditional and MARL-based methods in various aspects.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源