摘要 Abstract

本文综述旨在为Frank–Wolfe算法(也称为条件梯度算法)在函数最小化中的应用提供一个简洁的入门介绍和系统的概览。这些算法在凸优化问题中特别有用,尤其是在线性优化比投影更便宜的情况下。本文材料的选择遵循了突出关键思想的原则,并介绍了我们认为可能在未来变得重要的新方法,同时对早期工作也进行了充分引用,这对发展新的方法至关重要。然而,我们的选择有时可能存在偏颇,并不一定反映研究社区的共识,我们也肯定遗漏了一些近期的重要贡献。毕竟,Frank–Wolfe研究领域非常活跃,使得该领域成为一个不断变化的目标。我们提前为任何可能的偏差深表歉意,并完全承认:我们站在巨人的肩膀上。

The purpose of this survey is to serve both as a gentle introduction and a coherent overview of state-of-the-art Frank--Wolfe algorithms, also called conditional gradient algorithms, for function minimization. These algorithms are especially useful in convex optimization when linear optimization is cheaper than projections. The selection of the material has been guided by the principle of highlighting crucial ideas as well as presenting new approaches that we believe might become important in the future, with ample citations even of old works imperative in the development of newer methods. Yet, our selection is sometimes biased, and need not reflect consensus of the research community, and we have certainly missed recent important contributions. After all the research area of Frank--Wolfe is very active, making it a moving target. We apologize sincerely in advance for any such distortions and we fully acknowledge: We stand on the shoulder of giants.

条件梯度方法 - arXiv