论文标题
3D MRI超级分辨率的无监督代表性学习和降解适应
Unsupervised Representation Learning for 3D MRI Super Resolution with Degradation Adaptation
论文作者
论文摘要
高分辨率(HR)磁共振成像对于帮助医生的诊断和图像引导处理至关重要。但是,获取人力资源图像可能耗时且昂贵。因此,基于深度学习的超分辨率重建(SRR)已成为从低分辨率(LR)图像生成超分辨率(SR)图像的有前途的解决方案。不幸的是,训练此类神经网络需要对齐真实的人力资源和LR图像对,这是由于在图像采集期间和之间的患者运动而获得的挑战。尽管可以通过图像登记来校正硬组织的刚性运动,但对齐变形的软组织是复杂的,这使得用真实的HR和LR图像对训练神经网络是不切实际的。先前的研究专注于使用正宗的HR图像和下采样的合成LR图像上的SRR。但是,合成和真实LR图像之间降解表示的差异抑制了从真实的LR图像重建的SR图像的质量。为了解决这个问题,我们提出了一个新颖的无监督降解适应网络(UDEAN)。我们的网络由退化学习网络和SRR网络组成。退化学习网络使用从未对准或不配对的LR图像中学到的降解表示形式下调了HR图像。然后,SRR网络将映射从下采样的HR图像学习到原始图像。实验结果表明,我们的方法表现优于最先进的网络,是解决临床环境中挑战的有前途的解决方案。
High-resolution (HR) magnetic resonance imaging is critical in aiding doctors in their diagnoses and image-guided treatments. However, acquiring HR images can be time-consuming and costly. Consequently, deep learning-based super-resolution reconstruction (SRR) has emerged as a promising solution for generating super-resolution (SR) images from low-resolution (LR) images. Unfortunately, training such neural networks requires aligned authentic HR and LR image pairs, which are challenging to obtain due to patient movements during and between image acquisitions. While rigid movements of hard tissues can be corrected with image registration, aligning deformed soft tissues is complex, making it impractical to train neural networks with authentic HR and LR image pairs. Previous studies have focused on SRR using authentic HR images and down-sampled synthetic LR images. However, the difference in degradation representations between synthetic and authentic LR images suppresses the quality of SR images reconstructed from authentic LR images. To address this issue, we propose a novel Unsupervised Degradation Adaptation Network (UDEAN). Our network consists of a degradation learning network and an SRR network. The degradation learning network downsamples the HR images using the degradation representation learned from the misaligned or unpaired LR images. The SRR network then learns the mapping from the down-sampled HR images to the original ones. Experimental results show that our method outperforms state-of-the-art networks and is a promising solution to the challenges in clinical settings.