论文标题
使用单个超网络计算多个图像重建
Computing Multiple Image Reconstructions with a Single Hypernetwork
论文作者
论文摘要
基于深度学习的技术实现最新的技术会导致各种图像重建任务,例如压缩感应。这些方法几乎总是具有超参数,例如在优化损耗函数中平衡不同项的权重系数。典型的方法是训练模型,以通过某些经验或理论理由确定的超参数设置。因此,在推理时,模型只能计算与预定的超参数值相对应的重建。在这项工作中,我们提出了一种基于超网络的方法,称为HyperRecon,以训练不可知论到超参数设置的重建模型。在推理时,HyperRecon可以有效产生各种重建,每个重建都对应于不同的高参数值。在此框架中,用户有权根据自己的判断选择最有用的输出。我们使用两个大规模且公开可用的MRI数据集演示了压缩感测,超分辨率和去索任务的方法。我们的代码可从https://github.com/alanqrwang/hyperrecon获得。
Deep learning based techniques achieve state-of-the-art results in a wide range of image reconstruction tasks like compressed sensing. These methods almost always have hyperparameters, such as the weight coefficients that balance the different terms in the optimized loss function. The typical approach is to train the model for a hyperparameter setting determined with some empirical or theoretical justification. Thus, at inference time, the model can only compute reconstructions corresponding to the pre-determined hyperparameter values. In this work, we present a hypernetwork-based approach, called HyperRecon, to train reconstruction models that are agnostic to hyperparameter settings. At inference time, HyperRecon can efficiently produce diverse reconstructions, which would each correspond to different hyperparameter values. In this framework, the user is empowered to select the most useful output(s) based on their own judgement. We demonstrate our method in compressed sensing, super-resolution and denoising tasks, using two large-scale and publicly-available MRI datasets. Our code is available at https://github.com/alanqrwang/hyperrecon.