论文标题

联邦学习可以拯救地球吗?

Can Federated Learning Save The Planet?

论文作者

Qiu, Xinchi, Parcollet, Titouan, Beutel, Daniel J., Topal, Taner, Mathur, Akhil, Lane, Nicholas D.

论文摘要

尽管结果令人印象深刻,但深度学习的技术还引起了经常在数据中心进行的培训程序引起的严重隐私和环境问题。作为回应,已经出现了集中培训的替代方案,例如联邦学习(FL)。也许出乎意料的是,尤其是佛罗里达州,开始在全球范围内部署,这些公司必须遵守源自政府和公民社会的新法律要求和政策。但是,与FL相关的潜在环境影响尚不清楚且未开发。本文提供了有史以来对FL碳足迹的首次系统研究。首先,我们提出了一个严格的模型来量化碳足迹,从而促进了对FL设计与碳排放之间关系的研究。然后,我们将FL的碳足迹与传统的集中学习进行了比较。我们的发现显示,尽管收敛速度较慢,但​​FL可能比数据中心GPU更绿色。最后,我们强调并将报告的结果与FL的未来挑战和趋势联系起来,以减少其环境影响,包括算法效率,硬件能力和更强的行业透明度。

Despite impressive results, deep learning-based technologies also raise severe privacy and environmental concerns induced by the training procedure often conducted in data centers. In response, alternatives to centralized training such as Federated Learning (FL) have emerged. Perhaps unexpectedly, FL, in particular, is starting to be deployed at a global scale by companies that must adhere to new legal demands and policies originating from governments and the civil society for privacy protection. However, the potential environmental impact related to FL remains unclear and unexplored. This paper offers the first-ever systematic study of the carbon footprint of FL. First, we propose a rigorous model to quantify the carbon footprint, hence facilitating the investigation of the relationship between FL design and carbon emissions. Then, we compare the carbon footprint of FL to traditional centralized learning. Our findings show FL, despite being slower to converge, can be a greener technology than data center GPUs. Finally, we highlight and connect the reported results to the future challenges and trends in FL to reduce its environmental impact, including algorithms efficiency, hardware capabilities, and stronger industry transparency.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源