论文标题
使用RGB-D摄像机实时同时同时进行3D头部建模和面部运动捕获
Real-time Simultaneous 3D Head Modeling and Facial Motion Capture with an RGB-D camera
论文作者
论文摘要
我们提出了一种使用消费级RGB-D摄像机在实时动画3D头模型中构建的方法。我们提出的方法是第一个提供同时全面的面部运动跟踪和用户头的详细3D模型的方法。任何人的头都可以立即重建，并捕获他的面部运动，而无需进行任何培训或预扫描。用户开始在第一帧中以中立的表达方式朝相机面对相机，但可以随意移动，交谈和改变他的脸部表情。面部运动是使用混合形状动画模型捕获的，而几何详细信息则是使用模板网格上映射的偏差图像捕获的。我们采用有效的算法为实时和实时的头部头部变形3D模型而做出了贡献。我们在各种具有各种头部姿势和面部表情的受试者上展示了鲁棒和高保真的面部运动捕获和3D头模型结果。
We propose a method to build in real-time animated 3D head models using a consumer-grade RGB-D camera. Our proposed method is the first one to provide simultaneously comprehensive facial motion tracking and a detailed 3D model of the user's head. Anyone's head can be instantly reconstructed and his facial motion captured without requiring any training or pre-scanning. The user starts facing the camera with a neutral expression in the first frame, but is free to move, talk and change his face expression as he wills otherwise. The facial motion is captured using a blendshape animation model while geometric details are captured using a Deviation image mapped over the template mesh. We contribute with an efficient algorithm to grow and refine the deforming 3D model of the head on-the-fly and in real-time. We demonstrate robust and high-fidelity simultaneous facial motion capture and 3D head modeling results on a wide range of subjects with various head poses and facial expressions.
