论文标题
相同但不同的网络:半监督的缺陷检测和标准化流量
Same Same But DifferNet: Semi-Supervised Defect Detection with Normalizing Flows
论文作者
论文摘要
在制造过程中发现制造错误至关重要,以确保产品质量和安全标准。由于许多缺陷很少发生,并且其特征大多是未知的,因此它们的检测仍然是一个开放的研究问题。为此,我们提出了Difternet:它利用卷积神经网络提取的特征的描述性使用归一化的流量来估计其密度。标准化的流非常适合处理低维数据分布。但是,他们在图像的高维度上挣扎。因此,我们采用了一个多尺度的特征提取器,该特征提取器使标准化流程能够为图像分配有意义的可能性。基于这些可能性,我们开发出表示缺陷的评分函数。此外,将分数传播回图像可以启用像素定位。为了达到较高的鲁棒性和性能,我们利用训练和评估中的多重转换。与大多数其他方法相反,我们的方法不需要大量的训练样本,并且表现良好,低至16张图像。我们证明了与现有方法相比,在具有挑战性和新提出的MVTEC AD和磁性缺陷的数据集上的表现优于现有方法。
The detection of manufacturing errors is crucial in fabrication processes to ensure product quality and safety standards. Since many defects occur very rarely and their characteristics are mostly unknown a priori, their detection is still an open research question. To this end, we propose DifferNet: It leverages the descriptiveness of features extracted by convolutional neural networks to estimate their density using normalizing flows. Normalizing flows are well-suited to deal with low dimensional data distributions. However, they struggle with the high dimensionality of images. Therefore, we employ a multi-scale feature extractor which enables the normalizing flow to assign meaningful likelihoods to the images. Based on these likelihoods we develop a scoring function that indicates defects. Moreover, propagating the score back to the image enables pixel-wise localization. To achieve a high robustness and performance we exploit multiple transformations in training and evaluation. In contrast to most other methods, ours does not require a large number of training samples and performs well with as low as 16 images. We demonstrate the superior performance over existing approaches on the challenging and newly proposed MVTec AD and Magnetic Tile Defects datasets.