论文标题

从单眼图像中恢复3D人网:调查

Recovering 3D Human Mesh from Monocular Images: A Survey

论文作者

Tian, Yating, Zhang, Hongwen, Liu, Yebin, Wang, Limin

论文摘要

从单眼图像中估算人的姿势和形状是计算机视觉中的长期问题。自统计体模型的发布以来,3D人网恢复一直在引起更广泛的关注。以相同的目标获得了良好的和物理上合理的网格结果,已经开发了两个范式来克服2到3D提升过程中的挑战:i)基于优化的范式,其中不同的数据项和正则化项被利用为优化目标; ii)基于回归的范式,其中采用了深度学习技术以端到端的方式解决该问题。同时,持续的努力致力于提高各种数据集的3D网格标签的质量。尽管在过去十年中取得了显着的进展,但由于灵活的身体运动,不同的外观,复杂的环境和野外注释不足,任务仍然具有挑战性。据我们所知,这是第一个重点介绍单程3D人网恢复任务的调查。我们首先引入身体模型,然后通过对其优势和劣势进行深入分析,从而详细说明恢复框架和培训目标。我们还总结了数据集,评估指标和基准结果。最终讨论了开放问题和未来的方向,希望激励研究人员并促进他们在这一领域的研究。可以在https://github.com/tinatiansjz/hmr-survey上找到定期更新的项目页面。

Estimating human pose and shape from monocular images is a long-standing problem in computer vision. Since the release of statistical body models, 3D human mesh recovery has been drawing broader attention. With the same goal of obtaining well-aligned and physically plausible mesh results, two paradigms have been developed to overcome challenges in the 2D-to-3D lifting process: i) an optimization-based paradigm, where different data terms and regularization terms are exploited as optimization objectives; and ii) a regression-based paradigm, where deep learning techniques are embraced to solve the problem in an end-to-end fashion. Meanwhile, continuous efforts are devoted to improving the quality of 3D mesh labels for a wide range of datasets. Though remarkable progress has been achieved in the past decade, the task is still challenging due to flexible body motions, diverse appearances, complex environments, and insufficient in-the-wild annotations. To the best of our knowledge, this is the first survey that focuses on the task of monocular 3D human mesh recovery. We start with the introduction of body models and then elaborate recovery frameworks and training objectives by providing in-depth analyses of their strengths and weaknesses. We also summarize datasets, evaluation metrics, and benchmark results. Open issues and future directions are discussed in the end, hoping to motivate researchers and facilitate their research in this area. A regularly updated project page can be found at https://github.com/tinatiansjz/hmr-survey.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源