论文标题
朝着空中图像的开放式语义分割
Towards Open-Set Semantic Segmentation of Aerial Images
论文作者
论文摘要
经典且最近深的计算机视觉方法针对可见光谱图像进行了优化,该图像通常用智能手机或摄像机获取的灰度或RGB Colorspaces编码。在遥感场中利用的图像来源更为罕见,是卫星和空中图像。但是,这些数据的模式识别方法的开发是相对较新的,这主要是由于这种类型的图像的可用性有限,因为直到最近它们才专门用于军事目的。访问包括光谱信息在内的航行图像的访问主要是由于无人机的低成本,廉价的成像卫星发射成本和新颖的公共数据集而增加。通常,遥感应用程序采用计算机视觉技术,严格建模用于封闭的场景中的分类任务。但是,现实世界的任务很少适合封闭的设置上下文,经常呈现以前未知的类,将其描述为开放式场景。专注于这个问题,这是第一篇研究和开发语义分割技术的论文,用于用于遥感图像的开放场景方案。本文的主要贡献是:1)对开放式语义细分中相关作品的讨论,显示了可以将这些技术适应开放式遥感任务的证据; 2)开发和评估开放式语义分割的新方法。与同一数据集的封闭设置方法相比,我们的方法产生了竞争结果。
Classical and more recently deep computer vision methods are optimized for visible spectrum images, commonly encoded in grayscale or RGB colorspaces acquired from smartphones or cameras. A more uncommon source of images exploited in the remote sensing field are satellite and aerial images. However, the development of pattern recognition approaches for these data is relatively recent, mainly due to the limited availability of this type of images, as until recently they were used exclusively for military purposes. Access to aerial imagery, including spectral information, has been increasing mainly due to the low cost of drones, cheapening of imaging satellite launch costs, and novel public datasets. Usually remote sensing applications employ computer vision techniques strictly modeled for classification tasks in closed set scenarios. However, real-world tasks rarely fit into closed set contexts, frequently presenting previously unknown classes, characterizing them as open set scenarios. Focusing on this problem, this is the first paper to study and develop semantic segmentation techniques for open set scenarios applied to remote sensing images. The main contributions of this paper are: 1) a discussion of related works in open set semantic segmentation, showing evidence that these techniques can be adapted for open set remote sensing tasks; 2) the development and evaluation of a novel approach for open set semantic segmentation. Our method yielded competitive results when compared to closed set methods for the same dataset.