论文标题

MSA-MIL:基于多尺度注释的深层多重实例学习模型,用于分类和可视化肾小球尖峰

MSA-MIL: A deep residual multiple instance learning model based on multi-scale annotation for classification and visualization of glomerular spikes

论文作者

Chen, Yilin, Li, Ming, Wu, Yongfei, Liu, Xueyu, Hao, Fang, Zhou, Daoxiang, Zhou, Xiaoshuang, Wang, Chen

论文摘要

膜性肾病(MN)是一种频繁的成人肾病综合征,其临床发病率很高,可能引起各种并发症。在膜性肾病的活检显微镜载玻片中,肾小球基底膜上的尖刺投影是MN的突出特征。但是,由于整个活检载玻片包含大量肾小球,并且每个肾小球都包含许多峰值病变,因此尖峰的病理特征并不明显。因此,医生一一诊断肾小球的时间很耗时,而经验较少的病理学家很难诊断。在本文中,我们基于多尺度注释多构度学习(MSA-MIL)建立一个可视化的分类模型,以实现肾小球分类和尖峰可视化。 MSA-MIL模型主要涉及三个部分。首先,U-NET用于提取肾小球的区域,以确保后续算法学到的特征集中在肾小球本身内。其次,我们使用MIL来训练实例级分类器与MSA方法结合使用,以通过添加位置级标记的加强数据集来增强网络的学习能力,从而获得具有丰富语义的示例级级特征表示。最后,汇总了图像中每个图块的预测分数,以通过滑动窗口方法的使用来获得尖峰的分类结果的肾小球分类和可视化。实验结果证实,提出的MSA-MIL模型可以有效,准确地对正常的肾小球和尖刺的肾小球分类,并可视化峰值在肾小球中的位置。因此,所提出的模型可以为帮助临床医生诊断肾小球膜肾病提供良好的基础。

Membranous nephropathy (MN) is a frequent type of adult nephrotic syndrome, which has a high clinical incidence and can cause various complications. In the biopsy microscope slide of membranous nephropathy, spikelike projections on the glomerular basement membrane is a prominent feature of the MN. However, due to the whole biopsy slide contains large number of glomeruli, and each glomerulus includes many spike lesions, the pathological feature of the spikes is not obvious. It thus is time-consuming for doctors to diagnose glomerulus one by one and is difficult for pathologists with less experience to diagnose. In this paper, we establish a visualized classification model based on the multi-scale annotation multi-instance learning (MSA-MIL) to achieve glomerular classification and spikes visualization. The MSA-MIL model mainly involves three parts. Firstly, U-Net is used to extract the region of the glomeruli to ensure that the features learned by the succeeding algorithm are focused inside the glomeruli itself. Secondly, we use MIL to train an instance-level classifier combined with MSA method to enhance the learning ability of the network by adding a location-level labeled reinforced dataset, thereby obtaining an example-level feature representation with rich semantics. Lastly, the predicted scores of each tile in the image are summarized to obtain glomerular classification and visualization of the classification results of the spikes via the usage of sliding window method. The experimental results confirm that the proposed MSA-MIL model can effectively and accurately classify normal glomeruli and spiked glomerulus and visualize the position of spikes in the glomerulus. Therefore, the proposed model can provide a good foundation for assisting the clinical doctors to diagnose the glomerular membranous nephropathy.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源