分布鲁棒联邦学习:一种ADMM算法

Distributionally Robust Federated Learning: An ADMM Algorithm

摘要 Abstract

联邦学习(FL)旨在利用分散的数据协作训练机器学习(ML)模型,绕过了集中式数据聚合的需求。标准的FL模型通常假设所有数据来自相同的未知分布。然而在实际情况中,分散的数据常常表现出异质性。我们提出了一种新的FL模型,即分布鲁棒联邦学习(DRFL),它通过应用分布鲁棒优化来克服由数据异质性和分布模糊性带来的挑战。我们为DRFL推导出一个可处理的重构形式,并基于交替方向乘子法(ADMM)算法开发了一种新颖的求解方法来解决该问题。我们的实验结果表明,DRFL在数据异质性和模糊性下优于标准FL模型。

Federated learning (FL) aims to train machine learning (ML) models collaboratively using decentralized data, bypassing the need for centralized data aggregation. Standard FL models often assume that all data come from the same unknown distribution. However, in practical situations, decentralized data frequently exhibit heterogeneity. We propose a novel FL model, Distributionally Robust Federated Learning (DRFL), that applies distributionally robust optimization to overcome the challenges posed by data heterogeneity and distributional ambiguity. We derive a tractable reformulation for DRFL and develop a novel solution method based on the alternating direction method of multipliers (ADMM) algorithm to solve this problem. Our experimental results demonstrate that DRFL outperforms standard FL models under data heterogeneity and ambiguity.