论文标题

无位置的伪装生成网络

Location-Free Camouflage Generation Network

论文作者

Li, Yangyang, Zhai, Wei, Cao, Yang, Zha, Zheng-jun

论文摘要

伪装是一种常见的视觉现象,它是指将前景物体隐藏到背景图像中,使其对人眼短暂看不见。以前的工作通常是通过迭代优化过程实施的。但是,这些方法在1)使用具有任意结构的前景和背景有效地生成伪装图像; 2)将前景伪装到具有多个外观的区域(例如植被和山脉的交界处),这限制了其实际应用。为了解决这些问题,本文提出了一个新颖的无位置伪装生成网络(LCG-NET),该网络(LCG-NET)融合了前景和背景图像的高级特征,并通过一种推论产生结果。具体而言,设计了与位置对准的结构融合(PSF)模块,以基于前景和背景的点对点结构相似性来指导结构融合,并逐点引入局部外观特征。为了保留必要的可识别功能,在我们的管道下采用了新的沉浸式损失,而背景贴片外观损失则用于确保隐藏的物体在具有多个外观的区域看起来连续且自然。实验表明,我们的方法的结果与单个出现区域的最新面积一样令人满意,并且很可能完全看不见,但远远超过了多方面区域中最先进的质量。此外,我们的方法比以前的方法快数百倍。从我们方法的独特优势中受益,我们为伪装生成提供了一些下游应用,这表明了其潜力。相关代码和数据集将在https://github.com/tale17/lcg-net上发布。

Camouflage is a common visual phenomenon, which refers to hiding the foreground objects into the background images, making them briefly invisible to the human eye. Previous work has typically been implemented by an iterative optimization process. However, these methods struggle in 1) efficiently generating camouflage images using foreground and background with arbitrary structure; 2) camouflaging foreground objects to regions with multiple appearances (e.g. the junction of the vegetation and the mountains), which limit their practical application. To address these problems, this paper proposes a novel Location-free Camouflage Generation Network (LCG-Net) that fuse high-level features of foreground and background image, and generate result by one inference. Specifically, a Position-aligned Structure Fusion (PSF) module is devised to guide structure feature fusion based on the point-to-point structure similarity of foreground and background, and introduce local appearance features point-by-point. To retain the necessary identifiable features, a new immerse loss is adopted under our pipeline, while a background patch appearance loss is utilized to ensure that the hidden objects look continuous and natural at regions with multiple appearances. Experiments show that our method has results as satisfactory as state-of-the-art in the single-appearance regions and are less likely to be completely invisible, but far exceed the quality of the state-of-the-art in the multi-appearance regions. Moreover, our method is hundreds of times faster than previous methods. Benefitting from the unique advantages of our method, we provide some downstream applications for camouflage generation, which show its potential. The related code and dataset will be released at https://github.com/Tale17/LCG-Net.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源