基于Transformer和堆叠双向LSTM的多通道多步频谱预测
Multi-Channel Multi-Step Spectrum Prediction Using Transformer and Stacked Bi-LSTM
摘要 Abstract
频谱预测被认为是辅助频谱决策的关键技术。尽管在频谱预测的构建方面已经付出了巨大努力,但实现准确的频谱预测强调了更先进的解决方案的需求。本文提出了一种新的基于Transformer和堆叠双向LSTM(Bi-LSTM)的多通道多步频谱预测方法,命名为TSB。具体而言,我们利用多头注意力机制和堆叠Bi-LSTM构建了一种基于编码器-解码器架构的新Transformer。由多层多头注意力机制组成的自注意力机制能够持续关注多通道频谱序列的所有位置。堆叠Bi-LSTM可以通过多头注意力层逐层学习这些聚焦的编码特征。这种融合模式的优势在于能够深入捕捉多通道频谱数据的长期依赖关系。我们在一个由真实仿真平台生成的数据集上进行了广泛的实验。结果表明,所提出的算法优于基线方法。
Spectrum prediction is considered as a key technology to assist spectrum decision. Despite the great efforts that have been put on the construction of spectrum prediction, achieving accurate spectrum prediction emphasizes the need for more advanced solutions. In this paper, we propose a new multichannel multi-step spectrum prediction method using Transformer and stacked bidirectional LSTM (Bi- LSTM), named TSB. Specifically, we use multi-head attention and stacked Bi-LSTM to build a new Transformer based on encoder-decoder architecture. The self-attention mechanism composed of multiple layers of multi-head attention can continuously attend to all positions of the multichannel spectrum sequences. The stacked Bi-LSTM can learn these focused coding features by multi-head attention layer by layer. The advantage of this fusion mode is that it can deeply capture the long-term dependence of multichannel spectrum data. We have conducted extensive experiments on a dataset generated by a real simulation platform. The results show that the proposed algorithm performs better than the baselines.