随机梯度下降（SGD）是用于最小化机器学习中出现的目标函数的一种流行算法。对于恒定步长的SGD，迭代过程在一般状态空间上形成一个Markov链。聚焦于一类可分离（非凸）目标函数，我们建立了类似于“Doeblin型分解”的结果，即状态空间可以分解为一个一致瞬时集和一组不相交的吸收集的并集。每个吸收集中包含唯一的不变测度，而所有不变测度的集合则是这些测度的凸包。此外，证明了这些不变测度构成马氏链的全局吸引子，并且具有几何收敛速率。理论通过例子进一步阐明：（1）扩散近似无法刻画SGD的长时间动力学；（2）目标函数的全局最小值可能位于不变测度支撑集之外（即即使从全局最小值开始，SGD的迭代仍会离开该点）；（3）分岔现象可以使SGD的迭代在两个局部极小值之间切换。理论的关键在于将SGD的动力学视为单调迭代函数系统，并满足Dubins和Freedman 1966年以及Bhattacharya和Lee 1988年的“分裂条件”。

Stochastic gradient descent (SGD) is a popular algorithm for minimizing objective functions that arise in machine learning. For constant step-sized SGD, the iterates form a Markov chain on a general state space. Focusing on a class of separable (non-convex) objective functions, we establish a "Doeblin-type decomposition," in that the state space decomposes into a uniformly transient set and a disjoint union of absorbing sets. Each of the absorbing sets contains a unique invariant measure, with the set of all invariant measures being the convex hull. Moreover the set of invariant measures are shown to be global attractors to the Markov chain with a geometric convergence rate. The theory is highlighted with examples that show: (1) the failure of the diffusion approximation to characterize the long-time dynamics of SGD; (2) the global minimum of an objective function may lie outside the support of the invariant measures (i.e., even if initialized at the global minimum, SGD iterates will leave); and (3) bifurcations may enable the SGD iterates to transition between two local minima. Key ingredients in the theory involve viewing the SGD dynamics as a monotone iterated function system and establishing a "splitting condition" of Dubins and Freedman 1966 and Bhattacharya and Lee 1988.