带有噪声目标函数的离散共识全局优化方法
A discrete Consensus-Based Global Optimization Method with Noisy Objective Function
摘要 Abstract
共识优化是一种无导数的基于粒子的求解全局优化问题的方法。文献中已提出了该方法的多个版本,并证明了不同的收敛结果。然而,所有现有结果均假设在方法的每次迭代中都能精确评估目标函数。本文将离散时间共识优化(CBO)方法的收敛性分析扩展到仅能在给定点计算目标函数的随机噪声估计量的情形。特别是,我们证明了在适当的噪声假设下,粒子与解之间的平均平方距离的期望值可以在有限次迭代内任意小。此外,还给出了展示噪声影响的数值实验。
Consensus based optimization is a derivative-free particles-based method for the solution of global optimization problems. Several versions of the method have been proposed in the literature, and different convergence results have been proved. However, all existing results assume the objective function to be evaluated exactly at each iteration of the method. In this work, we extend the convergence analysis of a discrete-time CBO method to the case where only a noisy stochastic estimator of the objective function can be computed at a given point. In particular we prove that under suitable assumptions on the oracle's noise, the expected value of the mean squared distance of the particles from the solution can be made arbitrarily small in a finite number of iterations. Numerical experiments showing the impact of noise are also given.