LoGoFair:联邦学习中局部与全局公平性的后处理方法
LoGoFair: Post-Processing for Local and Global Fairness in Federated Learning
摘要 Abstract
联邦学习(FL)因其能够从分散的数据源中进行学习而备受关注。鉴于联邦学习在决策场景中的广泛应用,解决联邦学习中不同敏感组群(如女性、男性)的公平性问题至关重要。当前研究主要集中于促进每个客户端数据(局部公平性)或整个数据集跨所有客户端(全局公平性)的公平性。然而,专注于单一局部或全局公平性的现有方法未能解决两个关键挑战:(\textbf{CH1}) 在统计异质性下,全局公平性并不意味着局部公平性,反之亦然;(\textbf{CH2}) 在模型不可知设置下实现公平性。为了解决上述挑战,本文提出了一种新颖的后处理框架,用于在联邦学习环境中实现局部和全局公平性,即LoGoFair。为应对CH1,LoGoFair致力于在局部和全局公平性约束下寻求贝叶斯最优分类器,这在概率意义上实现了准确性与公平性的最佳平衡。为应对CH2,LoGoFair采用了一种模型不可知的联邦后处理程序,使客户端能够在确保局部公平性的同时协同优化全局公平性,从而在联邦学习中实现最优的公平分类器。在三个真实世界数据集上的实验结果进一步证明了所提出的LoGoFair框架的有效性。
Federated learning (FL) has garnered considerable interest for its capability to learn from decentralized data sources. Given the increasing application of FL in decision-making scenarios, addressing fairness issues across different sensitive groups (e.g., female, male) in FL is crucial. Current research often focuses on facilitating fairness at each client's data (local fairness) or within the entire dataset across all clients (global fairness). However, existing approaches that focus exclusively on either local or global fairness fail to address two key challenges: (\textbf{CH1}) Under statistical heterogeneity, global fairness does not imply local fairness, and vice versa. (\textbf{CH2}) Achieving fairness under model-agnostic setting. To tackle the aforementioned challenges, this paper proposes a novel post-processing framework for achieving both Local and Global Fairness in the FL context, namely LoGoFair. To address CH1, LoGoFair endeavors to seek the Bayes optimal classifier under local and global fairness constraints, which strikes the optimal accuracy-fairness balance in the probabilistic sense. To address CH2, LoGoFair employs a model-agnostic federated post-processing procedure that enables clients to collaboratively optimize global fairness while ensuring local fairness, thereby achieving the optimal fair classifier within FL. Experimental results on three real-world datasets further illustrate the effectiveness of the proposed LoGoFair framework.