STEAK: 面向家庭环境变化下物体重定位持续学习的流式网络

STEAK: Streaming Network for Continual Learning of Object Relocations under Household Context Drifts

摘要 Abstract

在真实世界的应用场景中,机器人被期望能够协助人类完成各种任务,并且在时间推移中不断适应动态变化。例如,在家庭环境中,机器人可以通过观察物体的移动规律来推测用户的习惯,并主动帮助用户获取所需物品。然而,这些交互数据本质上是非独立同分布的(non-i.i.d.),例如,当一个机器人服务于多个用户时,由于每个人的习惯不同,它可能会遇到不同的数据分布。这就带来了挑战:如何在不发生灾难性遗忘的情况下整合新知识。为了解决这一问题,我们提出了STREAK(自适应知识保持的空间时间重定位)框架,这是一种面向实际应用的机器人持续学习方法。该方法利用带正则化和回放技术的流式图神经网络,既能缓解环境漂移,又能保留过去的知识。我们的方法在时间和内存效率上表现优异,能够在无需对所有历史数据重新训练的情况下实现长期学习。我们在50多天的时间跨度内,在不同家庭环境下对STREAK进行了增量预测人类日常习惯的任务评估。结果表明,STREAK能够有效防止灾难性遗忘,同时保持泛化能力,成为一种适用于长期人机交互的可扩展解决方案。

In real-world settings, robots are expected to assist humans across diverse tasks and still continuously adapt to dynamic changes over time. For example, in domestic environments, robots can proactively help users by fetching needed objects based on learned routines, which they infer by observing how objects move over time. However, data from these interactions are inherently non-independent and non-identically distributed (non-i.i.d.), e.g., a robot assisting multiple users may encounter varying data distributions as individuals follow distinct habits. This creates a challenge: integrating new knowledge without catastrophic forgetting. To address this, we propose STREAK (Spatio Temporal RElocation with Adaptive Knowledge retention), a continual learning framework for real-world robotic learning. It leverages a streaming graph neural network with regularization and rehearsal techniques to mitigate context drifts while retaining past knowledge. Our method is time- and memory-efficient, enabling long-term learning without retraining on all past data, which becomes infeasible as data grows in real-world interactions. We evaluate STREAK on the task of incrementally predicting human routines over 50+ days across different households. Results show that it effectively prevents catastrophic forgetting while maintaining generalization, making it a scalable solution for long-term human-robot interactions.