论文标题
详细人员图像合成的区域自适应纹理增强
Region-adaptive Texture Enhancement for Detailed Person Image Synthesis
论文作者
论文摘要
产生令人信服的纹理细节的能力对于综合人图像的保真度至关重要。但是,现有方法通常遵循``基于翘曲的''策略,该策略通过用于姿势转移的相同途径传播外观特征。但是,大多数细粒度的功能将由于下采样而丢失,导致过度平滑的衣服和输出图像中缺少细节。在本文中,我们介绍了Rate-Net,这是一种具有鲜明纹理细节的人图像的新型框架。所提出的框架利用一个额外的纹理增强模块从源图像中提取外观信息,并估算出细粒的残留纹理图,这有助于从姿势传递模块中完善粗略的估计。此外,我们设计了一个有效的替代更新策略,以促进两个模块之间的相互指导,以提高形状和外观一致性。与现有网络相比,在DeepFashion基准数据集上进行的实验证明了我们框架的优势。
The ability to produce convincing textural details is essential for the fidelity of synthesized person images. However, existing methods typically follow a ``warping-based'' strategy that propagates appearance features through the same pathway used for pose transfer. However, most fine-grained features would be lost due to down-sampling, leading to over-smoothed clothes and missing details in the output images. In this paper we presents RATE-Net, a novel framework for synthesizing person images with sharp texture details. The proposed framework leverages an additional texture enhancing module to extract appearance information from the source image and estimate a fine-grained residual texture map, which helps to refine the coarse estimation from the pose transfer module. In addition, we design an effective alternate updating strategy to promote mutual guidance between two modules for better shape and appearance consistency. Experiments conducted on DeepFashion benchmark dataset have demonstrated the superiority of our framework compared with existing networks.