CARL: 针对等变图像配准的框架

CARL: A Framework for Equivariant Image Registration

摘要 Abstract

图像配准旨在估计一对图像之间的空间对应关系。这些估计通常是通过数值优化或深度网络回归获得的。这类估计器的一个理想属性是,对于一对图像的对应关系估计(例如,真实的最优对应),在输入图像发生形变时应保持不变。从形式上讲,该估计器应对所需的图像变换类具有等变性。在这项工作中,我们仔细分析了多步深度配准网络中的所需等变特性。基于这些分析,我们提出了一种新的等变概念:$[U,U]$等变性(网络对输入图像相同形变的等变性)和$[W,U]$等变性(其中输入图像可以经历不同的形变);我们证明了在一个合适的多步配准设置下,如果第一步具有$[W,U]$等变性,而其余步骤具有$[U,U]$等变性,则整体上可实现$[W,U]$等变性;我们还表明,常见的位移预测网络仅表现出对平移的$[U,U]$等变性,而非更强大的$[W,U]$等变性;最后,我们展示了如何通过结合坐标注意力机制和位移预测细化层(CARL)实现多步$[W,U]$等变性。总体而言,我们的方法在多个三维医学图像配准任务中取得了优异的实际配准性能,并在腹部配准这一具有挑战性的问题上优于现有的无监督方法。

Image registration estimates spatial correspondences between a pair of images. These estimates are typically obtained via numerical optimization or regression by a deep network. A desirable property of such estimators is that a correspondence estimate (e.g., the true oracle correspondence) for an image pair is maintained under deformations of the input images. Formally, the estimator should be equivariant to a desired class of image transformations. In this work, we present careful analyses of the desired equivariance properties in the context of multi-step deep registration networks. Based on these analyses we 1) introduce the notions of $[U,U]$ equivariance (network equivariance to the same deformations of the input images) and $[W,U]$ equivariance (where input images can undergo different deformations); we 2) show that in a suitable multi-step registration setup it is sufficient for overall $[W,U]$ equivariance if the first step has $[W,U]$ equivariance and all others have $[U,U]$ equivariance; we 3) show that common displacement-predicting networks only exhibit $[U,U]$ equivariance to translations instead of the more powerful $[W,U]$ equivariance; and we 4) show how to achieve multi-step $[W,U]$ equivariance via a coordinate-attention mechanism combined with displacement-predicting refinement layers (CARL). Overall, our approach obtains excellent practical registration performance on several 3D medical image registration tasks and outperforms existing unsupervised approaches for the challenging problem of abdomen registration.