利用浅层循环解码网络进行非线性动力学和Koopman算符的稀疏识别
Sparse identification of nonlinear dynamics and Koopman operators with Shallow Recurrent Decoder Networks
摘要 Abstract
对于具有高维性、测量噪声、部分观测以及数据采集成本高昂的真实时空数据建模极具挑战性。本文提出了一种名为SINDy-SHRED(Sparse Identification of Nonlinear Dynamics with SHallow REcurrent Decoder networks)的方法,用于联合解决传感问题和模型识别问题,该方法具有简单实现、高效计算和鲁棒性能的特点。SINDy-SHRED 使用门控循环单元对稀疏传感器测量的时间序列进行建模,并利用浅层解码网络从潜在状态空间重构完整的时空场。我们的算法引入了基于SINDy的正则化方法,当投影保持在一定集合内时,潜在空间会逐渐收敛到一个SINDy类函数空间。在将SINDy限制为线性模型的情况下,生成了Koopman-SHRED模型。SINDy-SHRED (i) 学习了一个符号化的、可解释的生成模型,用于复杂时空动态的简洁且低维潜在空间;(ii) 即使对于已知物理系统也能发现新的物理模型;(iii) 实现了全局凸损失景观下的证明稳健收敛;(iv) 在准确性、数据效率和训练时间方面表现优异,且所需模型参数更少。我们在偏微分方程(PDE)数据(如湍流)、海表温度真实传感器测量数据以及直接视频数据上进行了系统的实验研究。可解释的SINDy和Koopman模型能够实现稳定且准确的长期视频预测,在准确性、训练时间和数据需求方面优于当前所有基准深度学习模型,包括卷积LSTM、PredRNN、ResNet 和 SimVP。
Modeling real-world spatio-temporal data is exceptionally difficult due to inherent high dimensionality, measurement noise, partial observations, and often expensive data collection procedures. In this paper, we present Sparse Identification of Nonlinear Dynamics with SHallow REcurrent Decoder networks (SINDy-SHRED), a method to jointly solve the sensing and model identification problems with simple implementation, efficient computation, and robust performance. SINDy-SHRED uses Gated Recurrent Units to model the temporal sequence of sparse sensor measurements along with a shallow decoder network to reconstruct the full spatio-temporal field from the latent state space. Our algorithm introduces a SINDy-based regularization for which the latent space progressively converges to a SINDy-class functional, provided the projection remains within the set. In restricting SINDy to a linear model, a Koopman-SHRED model is generated. SINDy-SHRED (i) learns a symbolic and interpretable generative model of a parsimonious and low-dimensional latent space for the complex spatio-temporal dynamics, (ii) discovers new physics models even for well-known physical systems, (iii) achieves provably robust convergence with an observed globally convex loss landscape, and (iv) achieves superior accuracy, data efficiency, and training time, all with fewer model parameters. We conduct systematic experimental studies on PDE data such as turbulent flows, real-world sensor measurements for sea surface temperature, and direct video data. The interpretable SINDy and Koopman models of latent state dynamics enable stable and accurate long-term video predictions, outperforming all current baseline deep learning models in accuracy, training time, and data requirements, including Convolutional LSTM, PredRNN, ResNet, and SimVP.