论文标题
全息图像的神经网络处理
Neural network processing of holographic images
论文作者
论文摘要
Holodec是一种空中的云粒子成像仪,捕获了固定体积云的全息图像,以表征云颗粒的类型和尺寸,例如水滴和冰晶。云粒子特性包括位置,直径和形状。我们提出了一种全息图处理算法,即HolodeCML,该算法利用神经分割模型,GPU和计算并行化。基于仪器模型,使用合成生成的全息图训练了HolodeCML,并预测重建图像中发现的颗粒周围的掩模。从这些面具中,可以在三个维度中表征所检测到的颗粒的位置和大小。为了成功处理真实全息图,我们发现我们必须将一系列图像损坏变换和噪声应用于训练中使用的合成图像。 在此评估中,HolodeCML与标准处理方法具有可比的位置和尺寸估计性能,但在数千个手动标记的HoloDec图像上,将粒子检测提高了近20 \%。但是,只有在训练过程中对模拟图像进行图像损坏时,才会发生改进,从而模仿实际探针中的非理想条件。训练有素的模型还学会了将holodec图像中的伪影和其他杂质与颗粒区分开,即使训练数据集中没有这样的物体,而标准处理方法则难以将粒子与伪影分开。训练方法的新颖性(利用噪声)可以作为参数化Holodec探测器的非理想方面的一种手段,可以应用于其他领域,在这些领域中,理论模型无法完全描述仪器的现实操作以及无法从现实世界观察中获得监督学习所需的准确真实数据。
HOLODEC, an airborne cloud particle imager, captures holographic images of a fixed volume of cloud to characterize the types and sizes of cloud particles, such as water droplets and ice crystals. Cloud particle properties include position, diameter, and shape. We present a hologram processing algorithm, HolodecML, that utilizes a neural segmentation model, GPUs, and computational parallelization. HolodecML is trained using synthetically generated holograms based on a model of the instrument, and predicts masks around particles found within reconstructed images. From these masks, the position and size of the detected particles can be characterized in three dimensions. In order to successfully process real holograms, we find we must apply a series of image corrupting transformations and noise to the synthetic images used in training. In this evaluation, HolodecML had comparable position and size estimation performance to the standard processing method, but improved particle detection by nearly 20\% on several thousand manually labeled HOLODEC images. However, the improvement only occurred when image corruption was performed on the simulated images during training, thereby mimicking non-ideal conditions in the actual probe. The trained model also learned to differentiate artifacts and other impurities in the HOLODEC images from the particles, even though no such objects were present in the training data set, while the standard processing method struggled to separate particles from artifacts. The novelty of the training approach, which leveraged noise as a means for parameterizing non-ideal aspects of the HOLODEC detector, could be applied in other domains where the theoretical model is incapable of fully describing the real-world operation of the instrument and accurate truth data required for supervised learning cannot be obtained from real-world observations.