一帧足矣:用于毫米波信号生成的通用方法

One Snapshot is All You Need: A Generalized Method for mmWave Signal Generation

摘要 Abstract

使用毫米波技术的无线感知系统相较于传统的基于视觉的方法具有明显优势,例如增强隐私保护以及在弱光条件下的有效性。这些系统利用FMCW信号,在定位、手势识别等人机交互应用中取得了成功。然而,针对多样化应用场景的完整毫米波数据集非常稀缺,通常受限于预处理后的签名(如点云或RA热图)以及不一致的标注格式。为克服这些限制,我们提出了mmGen,这是一种专为全场景毫米波信号生成设计的新颖且通用的框架。通过构建物理信号传输模型,mmGen从构建的3D网格中合成人体反射和环境反射的毫米波信号。此外,我们引入了考虑材料属性、天线增益和多径反射的方法,提高了合成信号的真实性。我们在一套包含商用毫米波设备和Kinect传感器的原型系统上进行了大量实验。结果表明,在三种不同环境中,合成信号与真实捕获信号之间的Range-Angle和微多普勒特征的平均相似度分别超过0.91和0.89,证明了mmGen的有效性和实际应用价值。

Wireless sensing systems, particularly those using mmWave technology, offer distinct advantages over traditional vision-based approaches, such as enhanced privacy and effectiveness in poor lighting conditions. These systems, leveraging FMCW signals, have shown success in human-centric applications like localization, gesture recognition, and so on. However, comprehensive mmWave datasets for diverse applications are scarce, often constrained by pre-processed signatures (e.g., point clouds or RA heatmaps) and inconsistent annotation formats. To overcome these limitations, we propose mmGen, a novel and generalized framework tailored for full-scene mmWave signal generation. By constructing physical signal transmission models, mmGen synthesizes human-reflected and environment-reflected mmWave signals from the constructed 3D meshes. Additionally, we incorporate methods to account for material properties, antenna gains, and multipath reflections, enhancing the realism of the synthesized signals. We conduct extensive experiments using a prototype system with commercial mmWave devices and Kinect sensors. The results show that the average similarity of Range-Angle and micro-Doppler signatures between the synthesized and real-captured signals across three different environments exceeds 0.91 and 0.89, respectively, demonstrating the effectiveness and practical applicability of mmGen.