论文标题

Fedgraph:从图表上的聚合方法

FedGraph: an Aggregation Method from Graph Perspective

论文作者

Deng, Zhifang, Huang, Xiaohong, Li, Dandan, Yuan, Xueguang

论文摘要

随着日益加强的数据隐私法和困难的数据集中化,联邦学习(FL)已成为协作训练该模型的有效解决方案,同时保留每个客户的隐私。 FedAvg是一种标准聚合算法,它使每个客户端的数据集大小的比例作为聚合权重。但是,由于其固定的聚合权重和对数据分布的忽视,因此无法很好地处理非独立和相同分布的(非I.I.D)数据。在本文中,我们提出了一种聚合策略,可以有效地处理非I.I.D数据集,即Fedgraph,可以根据当地模型在整个培训过程中的训练条件进行适应的聚合权重调整。 Fedgraph考虑了三个因素,从粗略到细节:每个本地数据集大小的比例,模型图的拓扑因子和模型权重。我们通过将局部模型转换为拓扑图来计算局部模型之间的重力。 Fedgraph可以通过每个本地数据集,拓扑结构和模型权重的比例的加权组合来更好地探索本地模型之间的内部相关性。所提出的联合图已应用于MICCAI联合肿瘤分割挑战2021(FETS)数据集,验证结果表明,我们的方法超过了先前的最新时间,平均骰子相似性得分为2.76。源代码将在GitHub上找到。

With the increasingly strengthened data privacy act and the difficult data centralization, Federated Learning (FL) has become an effective solution to collaboratively train the model while preserving each client's privacy. FedAvg is a standard aggregation algorithm that makes the proportion of dataset size of each client as aggregation weight. However, it can't deal with non-independent and identically distributed (non-i.i.d) data well because of its fixed aggregation weights and the neglect of data distribution. In this paper, we propose an aggregation strategy that can effectively deal with non-i.i.d dataset, namely FedGraph, which can adjust the aggregation weights adaptively according to the training condition of local models in whole training process. The FedGraph takes three factors into account from coarse to fine: the proportion of each local dataset size, the topology factor of model graphs, and the model weights. We calculate the gravitational force between local models by transforming the local models into topology graphs. The FedGraph can explore the internal correlation between local models better through the weighted combination of the proportion each local dataset, topology structure, and model weights. The proposed FedGraph has been applied to the MICCAI Federated Tumor Segmentation Challenge 2021 (FeTS) datasets, and the validation results show that our method surpasses the previous state-of-the-art by 2.76 mean Dice Similarity Score. The source code will be available at Github.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源