摘要 Abstract
水库计算是一种机器学习形式,它利用非线性动态系统以比典型神经网络更具成本效益的方式执行复杂任务。近期在水库计算领域的许多进展,特别是量子水库计算,主要依赖于固有随机的水库。然而,使用这些系统的理论依据尚未得到充分确立。本文研究了随机水库计算机的通用性,在其中我们使用随机系统进行水库计算,并以每个水库状态的概率作为读出值而非状态本身。在随机水库计算中,整个水库计算机的状态数量可能随水库硬件规模呈指数级增长,从而提供紧凑设备尺寸的优势。我们证明了随机回声状态网络的类别,因此所有随机水库计算机的类别,都是通用近似类。我们还研究了两种实际随机水库计算机示例在分类和混沌时间序列预测中的性能。虽然散粒噪声是随机水库计算性能的一个限制因素,但在噪声影响较小的情况下,我们展示了其相较于具有相似硬件的确定性水库计算机的显著性能提升。
Reservoir computing is a form of machine learning that utilizes nonlinear dynamical systems to perform complex tasks in a cost-effective manner when compared to typical neural networks. Many recent advancements in reservoir computing, in particular quantum reservoir computing, make use of reservoirs that are inherently stochastic. However, the theoretical justification for using these systems has not yet been well established. In this paper, we investigate the universality of stochastic reservoir computers, in which we use a stochastic system for reservoir computing using the probabilities of each reservoir state as the readout instead of the states themselves. In stochastic reservoir computing, the number of distinct states of the entire reservoir computer can potentially scale exponentially with the size of the reservoir hardware, offering the advantage of compact device size. We prove that classes of stochastic echo state networks, and therefore the class of all stochastic reservoir computers, are universal approximating classes. We also investigate the performance of two practical examples of stochastic reservoir computers in classification and chaotic time series prediction. While shot noise is a limiting factor in the performance of stochastic reservoir computing, we show significantly improved performance compared to a deterministic reservoir computer with similar hardware in cases where the effects of noise are small.