分子量子变换器

Molecular Quantum Transformer

摘要 Abstract

Transformer模型因其强大的注意力机制在各类人工智能任务中取得了最先进的性能,但面临着高计算成本和内存占用等问题。尽管研究人员正在探索利用量子计算来改进Transformer的设计,但在经典数据上的表现仍然有限。随着对利用量子机器学习处理量子数据的关注增加,尤其是在量子化学领域,我们提出了分子量子变换器(Molecular Quantum Transformer, MQT)用于建模分子量子系统的相互作用。通过在分子构型上利用量子电路实现注意力机制,MQT能够高效地计算所有构型的基态能量。数值演示表明,在计算H₂、LiH、BeH₂和H₄的基态能量时,MQT的表现优于经典Transformer,凸显了Transformer结构中量子效应的潜力。此外,其在多样化分子数据上的预训练能力有助于高效学习新分子,从而以最小的额外努力扩展到复杂的分子系统。我们的方法为现有估计基态能量的量子算法提供了替代方案,在量子化学和材料科学领域开辟了新的研究途径。

The Transformer model, renowned for its powerful attention mechanism, has achieved state-of-the-art performance in various artificial intelligence tasks but faces challenges such as high computational cost and memory usage. Researchers are exploring quantum computing to enhance the Transformer's design, though it still shows limited success with classical data. With a growing focus on leveraging quantum machine learning for quantum data, particularly in quantum chemistry, we propose the Molecular Quantum Transformer (MQT) for modeling interactions in molecular quantum systems. By utilizing quantum circuits to implement the attention mechanism on the molecular configurations, MQT can efficiently calculate ground-state energies for all configurations. Numerical demonstrations show that in calculating ground-state energies for H_2, LiH, BeH_2, and H_4, MQT outperforms the classical Transformer, highlighting the promise of quantum effects in Transformer structures. Furthermore, its pretraining capability on diverse molecular data facilitates the efficient learning of new molecules, extending its applicability to complex molecular systems with minimal additional effort. Our method offers an alternative to existing quantum algorithms for estimating ground-state energies, opening new avenues in quantum chemistry and materials science.