论文标题
人体重塑的结构感知流量产生
Structure-Aware Flow Generation for Human Body Reshaping
论文作者
论文摘要
身体重塑是肖像磨练的重要过程。由于人体的复杂结构和多种外观,现有方法要么通过人体可变形模型落在3D域,要么依靠基于关键点的图像变形,从而导致效率低下和视觉质量不满意。在本文中,我们通过在身体结构先验的指导下(包括骨架和部分亲和力领域)制定端到端流量产生结构,并在任意姿势和服装下实现前所未有的可控性能。引入了一种组成注意机制,用于捕获人体的视觉感知相关性和结构关联,以增强相关部分之间的操纵一致性。为了进行全面的评估,我们构建了第一个大型身体重塑数据集,即BR-5K,其中包含5,000张肖像照片以及专业修饰的目标。广泛的实验表明,在视觉性能,可控性和效率方面,我们的方法显着优于现有的最新方法。该数据集可在我们的网站上找到:https://github.com/jianqiangren/flowbasadedbasedbasedreshaping。
Body reshaping is an important procedure in portrait photo retouching. Due to the complicated structure and multifarious appearance of human bodies, existing methods either fall back on the 3D domain via body morphable model or resort to keypoint-based image deformation, leading to inefficiency and unsatisfied visual quality. In this paper, we address these limitations by formulating an end-to-end flow generation architecture under the guidance of body structural priors, including skeletons and Part Affinity Fields, and achieve unprecedentedly controllable performance under arbitrary poses and garments. A compositional attention mechanism is introduced for capturing both visual perceptual correlations and structural associations of the human body to reinforce the manipulation consistency among related parts. For a comprehensive evaluation, we construct the first large-scale body reshaping dataset, namely BR-5K, which contains 5,000 portrait photos as well as professionally retouched targets. Extensive experiments demonstrate that our approach significantly outperforms existing state-of-the-art methods in terms of visual performance, controllability, and efficiency. The dataset is available at our website: https://github.com/JianqiangRen/FlowBasedBodyReshaping.