论文标题
无监督的多模式图像的共同信息神经估计
Mutual information neural estimation for unsupervised multi-modal registration of brain images
论文作者
论文摘要
图像引导的手术和治疗中的许多应用都需要快速,可靠的非线性,多模式图像登记。最近提出的无监督的基于深度学习的注册方法与迭代方法相比,仅在一小部分时间内表现出了较高的性能。大多数基于学习的方法都集中在单模式图像注册上。多模式注册的扩展取决于使用适当的相似性函数,例如互信息(MI)。我们建议指导基于深度学习的注册方法的培训,并在端到端可训练网络中的图像对之间进行MI估算。我们的结果表明,一个小的2层网络在单模式注册中产生竞争成果,并具有下秒的时间。与迭代和深度学习方法的比较表明,我们基于MI的方法在拓扑和质量上产生了较高的结果,其非呈非形态变换率极低。实时临床应用将受益于更好的解剖结构的视觉匹配和更少的注册故障/离群值。
Many applications in image-guided surgery and therapy require fast and reliable non-linear, multi-modal image registration. Recently proposed unsupervised deep learning-based registration methods have demonstrated superior performance compared to iterative methods in just a fraction of the time. Most of the learning-based methods have focused on mono-modal image registration. The extension to multi-modal registration depends on the use of an appropriate similarity function, such as the mutual information (MI). We propose guiding the training of a deep learning-based registration method with MI estimation between an image-pair in an end-to-end trainable network. Our results show that a small, 2-layer network produces competitive results in both mono- and multi-modal registration, with sub-second run-times. Comparisons to both iterative and deep learning-based methods show that our MI-based method produces topologically and qualitatively superior results with an extremely low rate of non-diffeomorphic transformations. Real-time clinical application will benefit from a better visual matching of anatomical structures and less registration failures/outliers.