论文标题
审查AI。的最佳实践和评分系统基于医学成像论文:第1部分分类
Best Practices and Scoring System on Reviewing A.I. based Medical Imaging Papers: Part 1 Classification
论文作者
论文摘要
随着AI的最新进展方法论及其在医学成像中的应用,使用这些技术来产生最新的分类性能,已经爆炸了相关研究计划。最终,这些研究计划在同行评审期刊上提出工作以考虑其工作而达到顶峰。迄今为止,接受与拒绝的标准通常是主观的。但是,可重复的科学需要可重复的审查。 SIIM的机器学习教育小组委员会已经确定了知识差距,并严重需要建立审查这些研究的准则。尽管该目标最近有几篇论文,但目前的工作是从机器学习从业者的角度写的。在本系列中,委员会将在基于AI的研究中讨论要遵循的最佳实践,并在示例中介绍所需的部分,并讨论应包括的研究,以使研究具有凝聚力,可重现,准确,准确和自我含糊。该系列中的第一个条目着重于图像分类的任务。讨论了诸如数据集策划,数据预处理步骤,定义适当的参考标准,数据分配,模型体系结构和培训之类的元素。这些部分是在典型的手稿中详细介绍的,其中内容描述了应包括的必要信息,以确保该研究具有足够的质量,可以考虑出版。本系列的目的是提供资源,不仅有助于改善基于A.I.的医学成像论文的审核过程,还可以促进研究研究中所有组成部分中介绍的信息的标准。我们希望在否则可能是定性审查过程中提供定量指标。
With the recent advances in A.I. methodologies and their application to medical imaging, there has been an explosion of related research programs utilizing these techniques to produce state-of-the-art classification performance. Ultimately, these research programs culminate in submission of their work for consideration in peer reviewed journals. To date, the criteria for acceptance vs. rejection is often subjective; however, reproducible science requires reproducible review. The Machine Learning Education Sub-Committee of SIIM has identified a knowledge gap and a serious need to establish guidelines for reviewing these studies. Although there have been several recent papers with this goal, this present work is written from the machine learning practitioners standpoint. In this series, the committee will address the best practices to be followed in an A.I.-based study and present the required sections in terms of examples and discussion of what should be included to make the studies cohesive, reproducible, accurate, and self-contained. This first entry in the series focuses on the task of image classification. Elements such as dataset curation, data pre-processing steps, defining an appropriate reference standard, data partitioning, model architecture and training are discussed. The sections are presented as they would be detailed in a typical manuscript, with content describing the necessary information that should be included to make sure the study is of sufficient quality to be considered for publication. The goal of this series is to provide resources to not only help improve the review process for A.I.-based medical imaging papers, but to facilitate a standard for the information that is presented within all components of the research study. We hope to provide quantitative metrics in what otherwise may be a qualitative review process.