论文标题
语义编码器引导的生成对抗性面部超分辨率网络
Semantic Encoder Guided Generative Adversarial Face Ultra-Resolution Network
论文作者
论文摘要
面部超分辨率是特定于域的图像超分辨率,旨在从其低分辨率(LR)对应物中产生高分辨率(HR)面部图像。在本文中,我们提出了一种新型的面部超分辨率方法,即语义编码器引导的生成对抗性面部超分辨率网络(SEGA-FURN),以超出多个超级尺度因素(例如,4 x和8x)的对应物,将其不对齐的小LR脸部图像与其HR对应物相对。所提出的网络由一个新颖的语义编码器组成,该语义编码器具有捕获嵌入式语义的能力来指导对抗性学习和一种新的发电机,该新颖的发电机使用了层次结构,该层次结构在内部密集块(RIDB)中被称为残差。此外,我们提出了一个联合歧视者,该歧视器歧视图像数据和嵌入式语义。联合判别器了解图像空间和潜在空间的关节概率分布。我们还使用相对论的平均最小二乘损失(RAL)作为对抗性损失,以减轻梯度消失的问题并增强训练程序的稳定性。大型面部数据集的广泛实验证明,该方法可以实现卓越的超分辨率结果,并且在定性和定量比较中都显着优于其他最先进的方法。
Face super-resolution is a domain-specific image super-resolution, which aims to generate High-Resolution (HR) face images from their Low-Resolution (LR) counterparts. In this paper, we propose a novel face super-resolution method, namely Semantic Encoder guided Generative Adversarial Face Ultra-Resolution Network (SEGA-FURN) to ultra-resolve an unaligned tiny LR face image to its HR counterpart with multiple ultra-upscaling factors (e.g., 4x and 8x). The proposed network is composed of a novel semantic encoder that has the ability to capture the embedded semantics to guide adversarial learning and a novel generator that uses a hierarchical architecture named Residual in Internal Dense Block (RIDB). Moreover, we propose a joint discriminator which discriminates both image data and embedded semantics. The joint discriminator learns the joint probability distribution of the image space and latent space. We also use a Relativistic average Least Squares loss (RaLS) as the adversarial loss to alleviate the gradient vanishing problem and enhance the stability of the training procedure. Extensive experiments on large face datasets have proved that the proposed method can achieve superior super-resolution results and significantly outperform other state-of-the-art methods in both qualitative and quantitative comparisons.