时间序列基础模型预测的轻量级在线自适应方法

Lightweight Online Adaption for Time Series Foundation Model Forecasts

摘要 Abstract

基础模型(FMs)作为一种有前景的时间序列预测方法已崭露头角。然而,由于在线学习计算成本较高,部署期间基础模型通常保持固定不变。因此,尽管有来自新到达数据的在线反馈,但部署的基础模型无法根据当前数据特征调整其预测结果。这引发了这样一个问题:是否可以通过高效利用这些反馈来提升模型性能?我们提出了AdapTS来回答这一问题。AdapTS是一种用于响应在线反馈调整基础模型预测的轻量级机制,它由两部分组成:a) AdapTS预测器,用于学习当前数据分布;b) AdapTS权重器,用于结合基础模型和AdapTS预测器的预测结果。我们在一系列标准时间序列数据集上评估了AdapTS与几种近期基础模型组合后的性能表现。在所有实验中,我们发现使用AdapTS确实能够提升性能。这项工作展示了如何通过有效利用在线反馈来改进基础模型的预测效果。

Foundation models (FMs) have emerged as a promising approach for time series forecasting. While effective, FMs typically remain fixed during deployment due to the high computational costs of learning them online. Consequently, deployed FMs fail to adapt their forecasts to current data characteristics, despite the availability of online feedback from newly arriving data. This raises the question of whether FM performance can be enhanced by the efficient usage of this feedback. We propose AdapTS to answer this question. AdapTS is a lightweight mechanism for the online adaption of FM forecasts in response to online feedback. AdapTS consists of two parts: a) the AdapTS-Forecaster which is used to learn the current data distribution; and b) the AdapTS-Weighter which is used to combine the forecasts of the FM and the AdapTS-Forecaster. We evaluate the performance of AdapTS in conjunction with several recent FMs across a suite of standard time series datasets. In all of our experiments we find that using AdapTS improves performance. This work demonstrates how efficient usage of online feedback can be used to improve FM forecasts.