论文标题
用于压缩辅助联盟学习的资源分配高畸变率
Resource Allocation for Compression-aided Federated Learning with High Distortion Rate
论文作者
论文摘要
最近,已经做出了相当多的工作来解决联合学习(例如,模型量化,数据稀疏和模型压缩)的沟通负担。但是,现有的方法提高了佛罗里达州的通信效率,从而在沟通效率和全球收敛速度之间进行了相当大的权衡。我们为压缩辅助AD的FL提出了优化问题,该问题捕获了失真率,参与IoT设备数量和收敛速率之间的关系。随后,目标函数是最大程度地减少FL收敛的总传输时间。由于问题是非凸,我们建议将其分解为子问题。根据FL模型的属性,我们首先确定参与FL过程的IoT设备的数量。然后,通过根据联盟游戏有效分配无线资源来优化IoT设备和服务器之间的通信。我们的理论分析表明,通过积极控制参与的物联网设备的数量,我们可以在保持沟通效率的同时避免压缩辅助FL的训练差异。
Recently, a considerable amount of works have been made to tackle the communication burden in federated learning (FL) (e.g., model quantization, data sparsification, and model compression). However, the existing methods, that boost the communication efficiency in FL, result in a considerable trade-off between communication efficiency and global convergence rate. We formulate an optimization problem for compression-aided FL, which captures the relationship between the distortion rate, number of participating IoT devices, and convergence rate. Following that, the objective function is to minimize the total transmission time for FL convergence. Because the problem is non-convex, we propose to decompose it into sub-problems. Based on the property of a FL model, we first determine the number of IoT devices participating in the FL process. Then, the communication between IoT devices and the server is optimized by efficiently allocating wireless resources based on a coalition game. Our theoretical analysis shows that, by actively controlling the number of participating IoT devices, we can avoid the training divergence of compression-aided FL while maintaining the communication efficiency.