论文标题
通过深度学习启用了计算干扰显微镜
Computational interference microscopy enabled by deep learning
论文作者
论文摘要
定量相成像(QPI)已广泛用于表征细胞和组织。空间光干扰显微镜(Slim)是一种高度敏感的QPI方法,由于其部分连贯的照明和公共路径干涉测定法。但是,由于四框相移方案,其采集率受到限制。另一方面,诸如衍射相显微镜(DPM)之类的外轴方法允许单发QPI。但是,基于激光的DPM系统由于斑点和多种反射而受到空间噪声的困扰。在平行的发展中,深度学习在生物成像领域被证明是有价值的,尤其是由于它能够将一种形式的对比度转化为另一种形式。在这里,我们建议使用深度学习产生来自DPM的合成,质量较高的高敏性相位图,单拍图像作为输入。我们使用了一个倒置的显微镜,其两个端口连接到DPM和Slim模块,以便我们可以在同一视野上访问两种类型的图像。我们基于U-NET构建了一个深度学习模型,并在1,000多对DPM和Slim图像上进行了培训。该模型学会了删除激光DPM中的斑点,并克服了测试集和新数据中的背景相位噪声。此外,我们将神经网络推断实现到实时采集软件中,该软件现在允许DPM用户实时观察一个极低的噪声相位图像。我们证明了使用血液涂片的计算干扰显微镜(CIM)成像的原理,因为它们在静态和动态条件下都包含红细胞和白细胞。
Quantitative phase imaging (QPI) has been widely applied in characterizing cells and tissues. Spatial light interference microscopy (SLIM) is a highly sensitive QPI method, due to its partially coherent illumination and common path interferometry geometry. However, its acquisition rate is limited because of the four-frame phase-shifting scheme. On the other hand, off-axis methods like diffraction phase microscopy (DPM), allows for single-shot QPI. However, the laser-based DPM system is plagued by spatial noise due to speckles and multiple reflections. In a parallel development, deep learning was proven valuable in the field of bioimaging, especially due to its ability to translate one form of contrast into another. Here, we propose using deep learning to produce synthetic, SLIM-quality, high-sensitivity phase maps from DPM, single-shot images as input. We used an inverted microscope with its two ports connected to the DPM and SLIM modules, such that we have access to the two types of images on the same field of view. We constructed a deep learning model based on U-net and trained on over 1,000 pairs of DPM and SLIM images. The model learned to remove the speckles in laser DPM and overcame the background phase noise in both the test set and new data. Furthermore, we implemented the neural network inference into the live acquisition software, which now allows a DPM user to observe in real-time an extremely low-noise phase image. We demonstrated this principle of computational interference microscopy (CIM) imaging using blood smears, as they contain both erythrocytes and leukocytes, in static and dynamic conditions.