基于音频信号的HearFit+:智能音箱上的个性化健身监测
HearFit+: Personalized Fitness Monitoring via Audio Signals on Smart Speakers
摘要 Abstract
健身有助于增强肌肉力量、提高疾病抵抗力并改善体型。由于时间不足,如今许多人选择在家或办公室锻炼而非去健身房。然而,在缺乏专业指导的情况下,他们很难获得良好的健身效果。受此启发,我们提出了首个基于家庭/办公室智能音箱的个性化健身监测系统HearFit+。我们探讨了利用声学传感技术监测健身的可行性,并设计了一种基于多普勒频移的健身检测方法,采用短时能量对健身动作进行分割。通过深度学习,HearFit+能够同时实现健身分类和用户识别。结合增量学习,用户可以轻松添加新的健身动作。我们设计了4个评估指标(即持续时间、强度、连续性和流畅性)以帮助用户提升健身效果。通过对12名志愿者的超过9,000次10种类型健身动作的广泛实验表明,HearFit+在健身分类中的平均准确率达到96.13%,在用户识别中的准确率为91%。所有志愿者均确认HearFit+能够在各种环境中帮助提升健身效果。
Fitness can help to strengthen muscles, increase resistance to diseases, and improve body shape. Nowadays, a great number of people choose to exercise at home/office rather than at the gym due to lack of time. However, it is difficult for them to get good fitness effects without professional guidance. Motivated by this, we propose the first personalized fitness monitoring system, HearFit+, using smart speakers at home/office. We explore the feasibility of using acoustic sensing to monitor fitness. We design a fitness detection method based on Doppler shift and adopt the short time energy to segment fitness actions. Based on deep learning, HearFit+ can perform fitness classification and user identification at the same time. Combined with incremental learning, users can easily add new actions. We design 4 evaluation metrics (i.e., duration, intensity, continuity, and smoothness) to help users to improve fitness effects. Through extensive experiments including over 9,000 actions of 10 types of fitness from 12 volunteers, HearFit+ can achieve an average accuracy of 96.13% on fitness classification and 91% accuracy for user identification. All volunteers confirm that HearFit+ can help improve the fitness effect in various environments.