论文标题
3D GAN,可改善大量面部识别
A 3D GAN for Improved Large-pose Facial Recognition
论文作者
论文摘要
使用深卷积神经网络的面部识别依赖于大型面部图像数据集的可用性。需要许多身份示例,对于每个身份,需要大量图像才能使网络了解稳健性对类内部变化。在实践中,很难获得这样的数据集,尤其是那些包含适当姿势变化的数据集。生成的对抗网络(GAN)为此问题提供了潜在的解决方案,因为它们能够生成逼真的合成图像。然而,最近的研究表明,当前脱离身份姿势的方法不足。在这项工作中,我们将3D形态模型纳入了GAN的发电机,以便从野外图像中学习非线性纹理模型。这允许生成新的合成身份,并在不损害身份的情况下对姿势,照明和表达的操纵。我们的合成数据用于增强对面部识别网络的培训,并在具有挑战性的CFP和CPLFW数据集上进行了评估。
Facial recognition using deep convolutional neural networks relies on the availability of large datasets of face images. Many examples of identities are needed, and for each identity, a large variety of images are needed in order for the network to learn robustness to intra-class variation. In practice, such datasets are difficult to obtain, particularly those containing adequate variation of pose. Generative Adversarial Networks (GANs) provide a potential solution to this problem due to their ability to generate realistic, synthetic images. However, recent studies have shown that current methods of disentangling pose from identity are inadequate. In this work we incorporate a 3D morphable model into the generator of a GAN in order to learn a nonlinear texture model from in-the-wild images. This allows generation of new, synthetic identities, and manipulation of pose, illumination and expression without compromising the identity. Our synthesised data is used to augment training of facial recognition networks with performance evaluated on the challenging CFP and CPLFW datasets.