面向空中联邦学习的时龄感知部分梯度更新策略

Age-Aware Partial Gradient Update Strategy for Federated Learning Over the Air

摘要 Abstract

我们提出了一种面向空中联邦学习的时龄感知策略,用于更新梯度。该系统包含边缘服务器和多个客户端,它们协作以最小化全局损失函数。在每次通信轮次中,客户端执行本地训练,将梯度更新调制到一组共享的正交波形上,并同时将模拟信号传输给边缘服务器。边缘服务器从接收到的无线电信号中提取出带有噪声的聚合梯度,更新全局模型并广播给客户端进行下一轮本地计算。尽管允许所有客户端在每轮通信中上传信息,但系统受到可用波形载波数量有限的限制,只能传输全局模型的部分梯度参数。为了解决这一问题,我们的方法在边缘服务器上维护一个时龄向量,跟踪全局模型每个坐标上次更新的时间。服务器利用此信息优先选择需要传输的梯度条目,确保过时但仍重要的参数能够更频繁地得到更新。我们推导了所提算法的收敛速率以量化其有效性。此外,基于MNIST和CIFAR-10数据集的实验评估表明,与基线方法相比,我们的方法实现了更高的准确率和更稳定的收敛性能,展示了其在提高空中联邦学习系统通信效率方面的潜力。

We propose an age-aware strategy to update gradients in an over-the-air federated learning system. The system comprises an edge server and multiple clients, collaborating to minimize a global loss function. In each communication round, clients perform local training, modulate their gradient updates onto a set of shared orthogonal waveforms, and simultaneously transmit the analog signals to the edge server. The edge server then extracts a noisy aggregated gradient from the received radio signal, updates the global model, and broadcasts it to the clients for the next round of local computing. Despite enabling all clients to upload information in every communication round, the system is constrained by the limited number of available waveform carriers, allowing only a subset of gradient parameters to be transmitted. To address this issue, our method maintains an age vector on the edge server, tracking the time elapsed since each coordinate of the global model was last updated. The server leverages this information to prioritize gradient entries for transmission, ensuring that outdated yet significant parameters are updated more frequently. We derive the convergence rate of the proposed algorithm to quantify its effectiveness. Furthermore, experimental evaluations on the MNIST and CIFAR-10 datasets demonstrate that our approach achieves higher accuracy and more stable convergence performance compared to baseline methods, highlighting its potential for improving communication efficiency in over-the-air federated learning systems.

面向空中联邦学习的时龄感知部分梯度更新策略 - arXiv