论文标题
关于基于深度学习的MRI重建对图像转换的鲁棒性
On the Robustness of deep learning-based MRI Reconstruction to image transformations
论文作者
论文摘要
尽管深度学习(DL)在加速的磁共振成像(MRI)上引起了很多关注,但最近的研究表明,很小的输入扰动可能导致基于DL的MRI重建模型的不稳定性。但是,鲁棒性这些模型的方法欠发达。与图像分类相比,考虑其基于回归的学习目标,有限的培训数据以及缺乏有效的鲁棒性指标,实现强大的MRI图像重建网络可能更具挑战性。为了避免上述局限性,我们的工作通过健壮的机器学习镜头重新审视了基于DL的图像重建问题。我们发现了MRI图像重建的新不稳定性来源,即缺乏针对输入(例如旋转和切口的空间转换)的重建鲁棒性。受到这种新的鲁棒性指标的启发,我们开发了一种鲁棒性吸引的图像重建方法,可以防御像素的对抗性扰动以及空间转换。还进行了广泛的实验,以证明我们提出的方法的有效性。
Although deep learning (DL) has received much attention in accelerated magnetic resonance imaging (MRI), recent studies show that tiny input perturbations may lead to instabilities of DL-based MRI reconstruction models. However, the approaches of robustifying these models are underdeveloped. Compared to image classification, it could be much more challenging to achieve a robust MRI image reconstruction network considering its regression-based learning objective, limited amount of training data, and lack of efficient robustness metrics. To circumvent the above limitations, our work revisits the problem of DL-based image reconstruction through the lens of robust machine learning. We find a new instability source of MRI image reconstruction, i.e., the lack of reconstruction robustness against spatial transformations of an input, e.g., rotation and cutout. Inspired by this new robustness metric, we develop a robustness-aware image reconstruction method that can defend against both pixel-wise adversarial perturbations as well as spatial transformations. Extensive experiments are also conducted to demonstrate the effectiveness of our proposed approaches.