摘要 Abstract
本文研究了一个分布式自适应优化问题,其中所有代理只能访问其局部代价函数以及一个公共未知参数,而它们的目标是在连接网络中协同估计真实参数并找到最优解。目前尚未有针对此类问题的一般数学框架。我们旨在为解决分布式优化问题中的参数不确定性提供有价值的见解,并同时找到最优解。因此,我们提出了一种新颖的边预测边优化方案,该方案通过在对数信念上的加权平均利用分布式分数贝叶斯学习来更新未知参数的信念,并采用分布式梯度下降法来更新最优解的估计。然后,在合适假设下,我们证明了所有代理的信念和决策变量几乎肯定收敛到真实参数和真实参数下的最优解。我们进一步建立了信念序列的次线性收敛率。最后,通过数值实验验证了理论分析。
This paper considers a distributed adaptive optimization problem, where all agents only have access to their local cost functions with a common unknown parameter, whereas they mean to collaboratively estimate the true parameter and find the optimal solution over a connected network. A general mathematical framework for such a problem has not been studied yet. We aim to provide valuable insights for addressing parameter uncertainty in distributed optimization problems and simultaneously find the optimal solution. Thus, we propose a novel Prediction while Optimization scheme, which utilizes distributed fractional Bayesian learning through weighted averaging on the log-beliefs to update the beliefs of unknown parameters, and distributed gradient descent for renewing the estimation of the optimal solution. Then under suitable assumptions, we prove that all agents' beliefs and decision variables converge almost surely to the true parameter and the optimal solution under the true parameter, respectively. We further establish a sublinear convergence rate for the belief sequence. Finally, numerical experiments are implemented to corroborate the theoretical analysis.