论文标题
Byeglassesgan：身份保留脸部图像的眼镜
ByeGlassesGAN: Identity Preserving Eyeglasses Removal for Face Images
论文作者
论文摘要
在本文中，我们提出了一个新颖的图像到图像gan框架，用于去除眼镜，称为ByeGlassesgan，该框架用于自动检测眼镜的位置，然后将其从脸部图像中删除。我们的旁观者由编码器，面部解码器和分段解码器组成。编码器负责从源面图像中提取信息，而面部解码器则利用此信息来生成玻璃拍摄的图像。包括分割解码器，以预测眼镜的分割面膜和完整的面部区域。分割解码器生成的特征向量与面部解码器共享，这有助于更好地重建结果。我们的实验表明，ByeGlassesgan甚至可以在半透明的彩色眼镜或玻璃眼镜中为眼镜拍摄的脸部图像提供视觉吸引力的结果。此外，通过将方法作为面部识别实验中的预处理步骤，我们通过将方法应用于面部图像的面部识别精度显着提高。
In this paper, we propose a novel image-to-image GAN framework for eyeglasses removal, called ByeGlassesGAN, which is used to automatically detect the position of eyeglasses and then remove them from face images. Our ByeGlassesGAN consists of an encoder, a face decoder, and a segmentation decoder. The encoder is responsible for extracting information from the source face image, and the face decoder utilizes this information to generate glasses-removed images. The segmentation decoder is included to predict the segmentation mask of eyeglasses and completed face region. The feature vectors generated by the segmentation decoder are shared with the face decoder, which facilitates better reconstruction results. Our experiments show that ByeGlassesGAN can provide visually appealing results in the eyeglasses-removed face images even for semi-transparent color eyeglasses or glasses with glare. Furthermore, we demonstrate significant improvement in face recognition accuracy for face images with glasses by applying our method as a pre-processing step in our face recognition experiment.
