论文标题
FACEDET3D:带有3D几何细节预测的面部表情
FaceDet3D: Facial Expressions with 3D Geometric Detail Prediction
论文作者
论文摘要
面部表情引起了3D面几何形状的各种高级细节。例如,微笑会引起脸颊的皱纹或窝的形成,而生气的同时经常会引起额头的皱纹。人脸的可变形模型(3DMM)无法在其基于PCA的表示中捕获此类细节,因此在用于编辑表达式时无法生成此类细节。在这项工作中,我们介绍了FacedEt3D,这是一种与单个图像 - 几何面部细节生成与任何所需目标表达式一致的几何面部细节。面部细节表示为顶点位移图,然后由神经渲染器使用,以在任何所需的表达式和视图中进行照片真实地渲染任何单个图像的新颖图像。项目网站是:http://shahrukhathar.github.io/2020/12/14/facedet3d.html
Facial Expressions induce a variety of high-level details on the 3D face geometry. For example, a smile causes the wrinkling of cheeks or the formation of dimples, while being angry often causes wrinkling of the forehead. Morphable Models (3DMMs) of the human face fail to capture such fine details in their PCA-based representations and consequently cannot generate such details when used to edit expressions. In this work, we introduce FaceDet3D, a first-of-its-kind method that generates - from a single image - geometric facial details that are consistent with any desired target expression. The facial details are represented as a vertex displacement map and used then by a Neural Renderer to photo-realistically render novel images of any single image in any desired expression and view. The project website is: http://shahrukhathar.github.io/2020/12/14/FaceDet3D.html