具有自适应模型再校准的动态分配超网络在FCL中的应用

Dynamic Allocation Hypernetwork with Adaptive Model Recalibration for FCL

摘要 Abstract

联邦连续学习(Federated Continual Learning, FCL)为联邦学习(Federated Learning, FL)在现实场景中的适用性提供了一种新兴模式,在该模式下,任务在客户端之间动态且异步地演化,尤其是在医疗场景中。现有基于服务器端的FCL方法本质上通过客户端聚合涉及的所有任务来构建一个可连续学习的服务器模型。然而,这些方法面临以下挑战:(1) 对于之前已学习任务的灾难性遗忘,导致服务器模型中错误累积,难以维持对所有任务的全面知识。(2) 不同客户端处理异步任务时产生的偏置优化,导致不同客户端在相同时间步长上的优化目标发生冲突。本文首次提出了一种新颖的面向医学领域的服务器端FCL模式——具有自适应模型再校准的动态分配超网络(\textbf{FedDAH}),旨在促进客户端间不同且动态的任务流下的协作学习。为缓解灾难性遗忘问题,我们提出了动态分配超网络(DAHyper),设计了一个不断更新的超网络,用于管理任务标识符与其相关模型参数之间的映射关系,从而实现客户端间模型的动态分配。针对偏置优化问题,我们引入了一种新颖的自适应模型再校准(AMR)方法,将历史模型的候选变化纳入当前服务器更新,并根据相似度为不同时间步长上的相同任务分配权重,以实现持续优化。在AMOS数据集上的大量实验表明,我们的FedDAH在具有不同任务流的站点上优于其他FCL方法。代码已公开:https://github.com/jinlab-imvr/FedDAH。

Federated continual learning (FCL) offers an emerging pattern to facilitate the applicability of federated learning (FL) in real-world scenarios, where tasks evolve dynamically and asynchronously across clients, especially in medical scenario. Existing server-side FCL methods in nature domain construct a continually learnable server model by client aggregation on all-involved tasks. However, they are challenged by: (1) Catastrophic forgetting for previously learned tasks, leading to error accumulation in server model, making it difficult to sustain comprehensive knowledge across all tasks. (2) Biased optimization due to asynchronous tasks handled across different clients, leading to the collision of optimization targets of different clients at the same time steps. In this work, we take the first step to propose a novel server-side FCL pattern in medical domain, Dynamic Allocation Hypernetwork with adaptive model recalibration (\textbf{FedDAH}). It is to facilitate collaborative learning under the distinct and dynamic task streams across clients. To alleviate the catastrophic forgetting, we propose a dynamic allocation hypernetwork (DAHyper) where a continually updated hypernetwork is designed to manage the mapping between task identities and their associated model parameters, enabling the dynamic allocation of the model across clients. For the biased optimization, we introduce a novel adaptive model recalibration (AMR) to incorporate the candidate changes of historical models into current server updates, and assign weights to identical tasks across different time steps based on the similarity for continual optimization. Extensive experiments on the AMOS dataset demonstrate the superiority of our FedDAH to other FCL methods on sites with different task streams. The code is available:https://github.com/jinlab-imvr/FedDAH.