论文标题
希望您在这里：上下文感知人类一代
Wish You Were Here: Context-Aware Human Generation
论文作者
论文摘要
我们提出了一种新颖的方法，可以将对象（特别是人类）插入现有图像中，以便它们以逼真的方式融合，同时尊重场景的语义上下文。我们的方法涉及三个子网：鉴于场景中其他人的姿势和一个可选的边界框规范，第一个子网生成了新人的语义图。第二个网络基于多种外观组成部分的形式，将新颖人的像素及其混合面膜的像素提供。第三个网络完善了生成的面孔，以匹配目标人的面孔。我们的实验表现出令人信服的高分辨率输出在这个小说和具有挑战性的应用领域中。此外，对这三个网络进行单独评估，例如，以姿势转移基准为例，最先进的结果。
We present a novel method for inserting objects, specifically humans, into existing images, such that they blend in a photorealistic manner, while respecting the semantic context of the scene. Our method involves three subnetworks: the first generates the semantic map of the new person, given the pose of the other persons in the scene and an optional bounding box specification. The second network renders the pixels of the novel person and its blending mask, based on specifications in the form of multiple appearance components. A third network refines the generated face in order to match those of the target person. Our experiments present convincing high-resolution outputs in this novel and challenging application domain. In addition, the three networks are evaluated individually, demonstrating for example, state of the art results in pose transfer benchmarks.
