深度学习理论中的一个核心问题是理解神经网络如何学习分层特征。深度网络提取显著特征的能力不仅对其卓越的泛化能力至关重要，也是现代深度学习预训练和微调范式的基础。然而，从理论角度而言，这一特征学习过程仍未被充分理解，现有分析大多局限于两层网络。在本文中，我们证明了三层神经网络相较于两层网络具有更丰富的特征学习能力。我们分析了通过逐层梯度下降训练的三层网络所学习到的特征，并提出了一般性的定理，该定理界定了当目标函数具有特定分层结构时，达到低测试误差所需的样本复杂度和宽度上限。我们将此框架应用于具体统计学习场景——单指标模型以及二次特征的函数，并证明在后一种情况下，三层网络相较于所有已知的两层网络保证方法在样本复杂度上有所改进。这一改进的关键在于三层网络能够高效地学习非线性特征。随后，我们通过构造一个可通过三层网络上的梯度下降有效学习但无法被两层网络有效学习的函数，建立了具体的优化深度分离结果。我们的工作在理解三层神经网络相对于两层网络在特征学习方面的理论优势方面取得了进展。

One of the central questions in the theory of deep learning is to understand how neural networks learn hierarchical features. The ability of deep networks to extract salient features is crucial to both their outstanding generalization ability and the modern deep learning paradigm of pretraining and finetuneing. However, this feature learning process remains poorly understood from a theoretical perspective, with existing analyses largely restricted to two-layer networks. In this work we show that three-layer neural networks have provably richer feature learning capabilities than two-layer networks. We analyze the features learned by a three-layer network trained with layer-wise gradient descent, and present a general purpose theorem which upper bounds the sample complexity and width needed to achieve low test error when the target has specific hierarchical structure. We instantiate our framework in specific statistical learning settings -- single-index models and functions of quadratic features -- and show that in the latter setting three-layer networks obtain a sample complexity improvement over all existing guarantees for two-layer networks. Crucially, this sample complexity improvement relies on the ability of three-layer networks to efficiently learn nonlinear features. We then establish a concrete optimization-based depth separation by constructing a function which is efficiently learnable via gradient descent on a three-layer network, yet cannot be learned efficiently by a two-layer network. Our work makes progress towards understanding the provable benefit of three-layer neural networks over two-layer networks in the feature learning regime.