从大脑活动解码视觉体验是一项重大挑战。现有的fMRI到视频的方法通常专注于语义内容，而忽略了空间和运动信息，但这些方面同样重要，并且通过大脑中的不同通路进行处理。受此启发，我们提出了DecoFuse，这是一种新颖的受脑启发的框架，用于从fMRI信号中解码视频。它首先将视频分解为语义、空间和运动三个组成部分，然后分别解码每个部分，最后将它们融合以重构视频。这种方法不仅通过将复杂的视频解码任务分解为可管理的小任务简化了任务，而且通过消融研究建立了学习表示与生物对应物之间的更清晰联系。此外，我们的实验表明，相比之前的最先进方法有了显著改进，语义分类准确率达到82.4%，空间一致性准确率为70.6%，运动预测余弦相似度为0.212，视频生成的50类准确率为21.9%。此外，语义和空间信息的神经编码分析与双通路假说一致，进一步验证了腹侧和背侧通路的不同作用。总体而言，DecoFuse为fMRI到视频的解码提供了一个强大且生物学合理的框架。项目页面：https://chongjg.github.io/DecoFuse/。

Decoding visual experiences from brain activity is a significant challenge. Existing fMRI-to-video methods often focus on semantic content while overlooking spatial and motion information. However, these aspects are all essential and are processed through distinct pathways in the brain. Motivated by this, we propose DecoFuse, a novel brain-inspired framework for decoding videos from fMRI signals. It first decomposes the video into three components - semantic, spatial, and motion - then decodes each component separately before fusing them to reconstruct the video. This approach not only simplifies the complex task of video decoding by decomposing it into manageable sub-tasks, but also establishes a clearer connection between learned representations and their biological counterpart, as supported by ablation studies. Further, our experiments show significant improvements over previous state-of-the-art methods, achieving 82.4% accuracy for semantic classification, 70.6% accuracy in spatial consistency, a 0.212 cosine similarity for motion prediction, and 21.9% 50-way accuracy for video generation. Additionally, neural encoding analyses for semantic and spatial information align with the two-streams hypothesis, further validating the distinct roles of the ventral and dorsal pathways. Overall, DecoFuse provides a strong and biologically plausible framework for fMRI-to-video decoding. Project page: https://chongjg.github.io/DecoFuse/.