论文标题
无监督的降低:对比度学习符合自相似性
Unsupervised Deraining: Where Contrastive Learning Meets Self-similarity
论文作者
论文摘要
图像deraining是一个典型的低级图像恢复任务,旨在将雨水图像分解为两个可区分的图层:干净的图像层和雨层。大多数现有基于学习的DEDARNANE方法都是通过合成雨水对的监督培训。合成和真实降雨之间的域间隙使它们对不同的真实下雨场景的概括不那么概括。此外,现有的方法主要利用两层的属性,而其中很少有人考虑了两层之间的相互排斥关系。在这项工作中,我们提出了一种新型的非本地对比度学习(NLCL)方法,用于无监督的图像。因此,我们不仅利用样品中的固有自相似性属性,而且还利用了两层之间的互斥特性,从而更好地将雨层与清洁图像有所不同。具体而言,随着阳性的呈阳性,非本地自相似图像层斑块被拉在一起,并且随着负面因素被推开时,类似的雨层斑块。因此,在原始空间中接近的类似的正/负样品使我们有益于更丰富的歧视性表示。除了自相似性抽样策略外,我们还分析了如何在NLCL中选择适当的功能编码器。在不同的实际雨数据集上进行的广泛实验表明,所提出的方法在实际derain中获得了最先进的性能。
Image deraining is a typical low-level image restoration task, which aims at decomposing the rainy image into two distinguishable layers: the clean image layer and the rain layer. Most of the existing learning-based deraining methods are supervisedly trained on synthetic rainy-clean pairs. The domain gap between the synthetic and real rains makes them less generalized to different real rainy scenes. Moreover, the existing methods mainly utilize the property of the two layers independently, while few of them have considered the mutually exclusive relationship between the two layers. In this work, we propose a novel non-local contrastive learning (NLCL) method for unsupervised image deraining. Consequently, we not only utilize the intrinsic self-similarity property within samples but also the mutually exclusive property between the two layers, so as to better differ the rain layer from the clean image. Specifically, the non-local self-similarity image layer patches as the positives are pulled together and similar rain layer patches as the negatives are pushed away. Thus the similar positive/negative samples that are close in the original space benefit us to enrich more discriminative representation. Apart from the self-similarity sampling strategy, we analyze how to choose an appropriate feature encoder in NLCL. Extensive experiments on different real rainy datasets demonstrate that the proposed method obtains state-of-the-art performance in real deraining.