分布式聚合优化的加速算法

Accelerated Distributed Aggregative Optimization

摘要 Abstract

本文深入研究了网络中的分布式聚合优化问题。在此场景下,每个代理拥有自身的局部成本函数,该函数不仅依赖于局部状态变量,还依赖于所有代理状态变量的聚合函数。为加快优化过程,我们将重球法和Nesterov加速方法与分布式聚合梯度跟踪相结合,提出了两种创新算法,旨在解决分布式聚合优化问题。我们的分析表明,当目标函数强凸且梯度具有Lipschitz连续性,并且参数(如步长和动量系数)在特定范围内选择时,所提出的算法可以以全局线性收敛率收敛到最优解。此外,我们通过若干数值实验验证了所提出算法的有效性、鲁棒性和优越性。

This paper delves into the investigation of a distributed aggregative optimization problem within a network. In this scenario, each agent possesses its own local cost function, which relies not only on the local state variable but also on an aggregated function of state variables from all agents. To expedite the optimization process, we amalgamate the heavy ball and Nesterovs accelerated method with distributed aggregative gradient tracking, resulting in the proposal of two innovative algorithms, aimed at resolving the distributed aggregative optimization problem. Our analysis demonstrates that the proposed algorithms can converge to an optimal solution at a global linear convergence rate when the objective function is strongly convex with the Lipschitz-continuous gradient, and when the parameters (e.g., step size and momentum coefficients) are chosen within specific ranges. Additionally, we present several numerical experiments to verify the effectiveness, robustness and superiority of our proposed algorithms.

分布式聚合优化的加速算法 - arXiv