摘要 Abstract
全能图像修复旨在利用单一模型从各种类型的退化中恢复高质量图像,且无需事先了解损坏源。然而,现有方法往往难以有效且高效地处理多种退化类型。我们提出了Cat-AIR,一种新颖的基于\textbf{内}容和\textbf{任}务感知的\textbf{全}能\textbf{图}像\textbf{修}复框架。Cat-AIR引入了交替的空间-通道注意力机制,该机制能够自适应地平衡不同任务的局部和全局信息。具体而言,我们引入了跨层通道注意力和跨特征空间注意力,这些注意力机制根据内容和任务复杂度分配计算资源。此外,我们提出了一种平滑学习策略,使模型能够在保持现有任务性能的同时无缝适应新的修复任务。大量实验表明,Cat-AIR在广泛的修复任务中实现了最先进的结果,所需浮点运算次数(FLOPs)少于先前的方法,为高效的全能图像修复建立了新的基准。
All-in-one image restoration seeks to recover high-quality images from various types of degradation using a single model, without prior knowledge of the corruption source. However, existing methods often struggle to effectively and efficiently handle multiple degradation types. We present Cat-AIR, a novel \textbf{C}ontent \textbf{A}nd \textbf{T}ask-aware framework for \textbf{A}ll-in-one \textbf{I}mage \textbf{R}estoration. Cat-AIR incorporates an alternating spatial-channel attention mechanism that adaptively balances the local and global information for different tasks. Specifically, we introduce cross-layer channel attentions and cross-feature spatial attentions that allocate computations based on content and task complexity. Furthermore, we propose a smooth learning strategy that allows for seamless adaptation to new restoration tasks while maintaining performance on existing ones. Extensive experiments demonstrate that Cat-AIR achieves state-of-the-art results across a wide range of restoration tasks, requiring fewer FLOPs than previous methods, establishing new benchmarks for efficient all-in-one image restoration.