论文标题
基于涂鸦的边界感知网络,用于遥感图像中弱监督的显着对象检测
Scribble-based Boundary-aware Network for Weakly Supervised Salient Object Detection in Remote Sensing Images
论文作者
论文摘要
现有的基于CNN的显着对象检测(SOD)在很大程度上取决于大型像素级注释,该注释是劳动力密集,耗时且昂贵的。相比之下,稀疏的注释变得对显着对象检测界有吸引力。但是,很少有努力从稀疏注释中学习显着对象检测,尤其是在遥感领域。此外,稀疏注释通常包含少数信息,这使得训练一个表现出色的模型具有挑战性,从而导致其性能在很大程度上落后于完全监督的模型。尽管某些SOD方法采用了一些先前的提示来改善检测性能,但它们通常缺乏对物体边界的有针对性歧视,因此提供了边界定位较差的显着性图。为此,在本文中,我们提出了一个新型的弱监督的显着对象检测框架,以预测稀疏涂鸦注释中遥感图像的显着性。为了实现它,我们首先通过用涂料(即S-eor数据集)重新标记现有的大规模SOD数据集来构建基于涂鸦的遥感显着性数据集。之后,我们提出了一个基于涂鸦的新型边界感知网络(SBA-NET),用于遥感显着对象检测。具体而言,我们设计了一个边界感知模块(BAM)来探索对象边界语义,该模块是由边界标签生成(BLG)模块生成的高信心对象边界(Pseudo)标签明确监督的,迫使该模型学习突出对象结构的特征,从而增强对象的边界位置。然后,将边界语义与高级特征集成在一起,以指导涂鸦标签的监督下的显着对象检测。
Existing CNNs-based salient object detection (SOD) heavily depends on the large-scale pixel-level annotations, which is labor-intensive, time-consuming, and expensive. By contrast, the sparse annotations become appealing to the salient object detection community. However, few efforts are devoted to learning salient object detection from sparse annotations, especially in the remote sensing field. In addition, the sparse annotation usually contains scanty information, which makes it challenging to train a well-performing model, resulting in its performance largely lagging behind the fully-supervised models. Although some SOD methods adopt some prior cues to improve the detection performance, they usually lack targeted discrimination of object boundaries and thus provide saliency maps with poor boundary localization. To this end, in this paper, we propose a novel weakly-supervised salient object detection framework to predict the saliency of remote sensing images from sparse scribble annotations. To implement it, we first construct the scribble-based remote sensing saliency dataset by relabelling an existing large-scale SOD dataset with scribbles, namely S-EOR dataset. After that, we present a novel scribble-based boundary-aware network (SBA-Net) for remote sensing salient object detection. Specifically, we design a boundary-aware module (BAM) to explore the object boundary semantics, which is explicitly supervised by the high-confidence object boundary (pseudo) labels generated by the boundary label generation (BLG) module, forcing the model to learn features that highlight the object structure and thus boosting the boundary localization of objects. Then, the boundary semantics are integrated with high-level features to guide the salient object detection under the supervision of scribble labels.