indiSplit:为荧光显微镜图像分解引入强度认知
indiSplit: Bringing Severity Cognizance to Image Decomposition in Fluorescence Microscopy
摘要 Abstract
荧光显微镜作为生命科学进步的关键驱动力,同时也受到技术限制的影响。为克服这些限制,最近提出了计算复用技术,允许在单个图像中捕获多种细胞结构,并在后期进行分离。现有的图像分解方法是在一组叠加的输入图像及其相应的未混合目标图像上进行训练的。值得注意的是,对于给定的输入,叠加图像之间的相对强度(混合比)是事先未知的。然而,现有方法是在固定的叠加输入强度比上进行训练的,这使得它们无法意识到荧光显微镜中可能出现的相对强度范围。在这项工作中,我们提出了一种名为indiSplit的新方法,该方法能够认识到上述混合比的严重性。我们的想法基于InDI,这是一种流行的图像恢复迭代方法,也是接受任何给定输入中未知混合比的理想起点。我们引入了(i)一个适当地训练的回归网络,用于预测给定输入图像的退化水平(混合不对称性),以及(ii)一个特定于退化的归一化模块,使降解感知推理能够在所有混合比范围内进行。我们证明了这种方法解决了荧光显微镜中的两个相关任务,即图像分割和串扰去除,并通过实验证明了indiSplit在5个公开数据集上的适用性。我们将以宽松的许可发布所有源代码。
Fluorescence microscopy, while being a key driver for progress in the life sciences, is also subject to technical limitations. To overcome them, computational multiplexing techniques have recently been proposed, which allow multiple cellular structures to be captured in a single image and later be unmixed. Existing image decomposition methods are trained on a set of superimposed input images and the respective unmixed target images. It is critical to note that the relative strength (mixing ratio) of the superimposed images for a given input is a priori unknown. However, existing methods are trained on a fixed intensity ratio of superimposed inputs, making them not cognizant to the range of relative intensities that can occur in fluorescence microscopy. In this work, we propose a novel method called indiSplit that is cognizant of the severity of the above mentioned mixing ratio. Our idea is based on InDI, a popular iterative method for image restoration, and an ideal starting point to embrace the unknown mixing ratio in any given input. We introduce (i) a suitably trained regressor network that predicts the degradation level (mixing asymmetry) of a given input image and (ii) a degradation-specific normalization module, enabling degradation-aware inference across all mixing ratios. We show that this method solves two relevant tasks in fluorescence microscopy, namely image splitting and bleedthrough removal, and empirically demonstrate the applicability of indiSplit on $5$ public datasets. We will release all sources under a permissive license.