论文标题
3D面部细节动画和操纵的结构意识可编辑的可编译模型
Structure-aware Editable Morphable Model for 3D Facial Detail Animation and Manipulation
论文作者
论文摘要
可变形的模型对于3D面的统计建模至关重要。以前的可变形模型的作品主要集中在大规模的面部几何形状上，但忽略了面部细节。本文通过学习一种结构含义可编辑的形态模型（SEMM）来增强形态模型，以表示面部细节。 SEMM基于皱纹线的距离场引入了细节结构表示，并以细节位移进行建模，以建立更好的对应关系并实现对皱纹结构的直观操纵。此外，SEMM还引入了两个转换模块，以将表达式的混合物重量和年龄值转化为潜在空间的变化，从而可以在维持身份的同时进行有效的语义细节编辑。广泛的实验表明，所提出的模型紧凑地表示面部细节，在定性和定量上表达动画中的先前方法，并实现了面部细节的有效年龄编辑和皱纹线编辑。代码和模型可在https://github.com/gerwang/facial-detail-manipulation上找到。
Morphable models are essential for the statistical modeling of 3D faces. Previous works on morphable models mostly focus on large-scale facial geometry but ignore facial details. This paper augments morphable models in representing facial details by learning a Structure-aware Editable Morphable Model (SEMM). SEMM introduces a detail structure representation based on the distance field of wrinkle lines, jointly modeled with detail displacements to establish better correspondences and enable intuitive manipulation of wrinkle structure. Besides, SEMM introduces two transformation modules to translate expression blendshape weights and age values into changes in latent space, allowing effective semantic detail editing while maintaining identity. Extensive experiments demonstrate that the proposed model compactly represents facial details, outperforms previous methods in expression animation qualitatively and quantitatively, and achieves effective age editing and wrinkle line editing of facial details. Code and model are available at https://github.com/gerwang/facial-detail-manipulation.
