论文标题
最先进的审查:改善科学出版物的激进建议
State-of-Art-Reviewing: A Radical Proposal to Improve Scientific Publication
论文作者
论文摘要
同行评审构成了现代科学手稿评估的骨干。但是,在为科学界提供了289年的平等服务,该协议在2020年是否适合目的?在这项工作中,我们以负面的(强烈的拒绝,高信心)回答了这个问题,并提出了最先进的评论(SOAR),这是一种新的审查管道,可作为同行评审的“插件”替代品。我们方法的核心是将审查过程解释为一种多目标,大规模分布和极高的延迟优化,我们可以为PAC和CMT优势解决方案有效地确定并有效地解决。我们做出以下贡献:(1)我们提出了一种高度可扩展的,全自动的方法,用于审查,从优质的计算机视觉和机器学习会议中汲取灵感; (2)我们探讨了我们方法的几种实例,并证明Soar可以用于审查印刷品和预先浏览预印刷; (3)我们从最新一轮的野蛮CVPR拒绝中徒劳地徒劳地徘徊,徒劳地搜寻宣泄。
Peer review forms the backbone of modern scientific manuscript evaluation. But after two hundred and eighty-nine years of egalitarian service to the scientific community, does this protocol remain fit for purpose in 2020? In this work, we answer this question in the negative (strong reject, high confidence) and propose instead State-Of-the-Art Review (SOAR), a neoteric reviewing pipeline that serves as a 'plug-and-play' replacement for peer review. At the heart of our approach is an interpretation of the review process as a multi-objective, massively distributed and extremely-high-latency optimisation, which we scalarise and solve efficiently for PAC and CMT-optimal solutions. We make the following contributions: (1) We propose a highly scalable, fully automatic methodology for review, drawing inspiration from best-practices from premier computer vision and machine learning conferences; (2) We explore several instantiations of our approach and demonstrate that SOAR can be used to both review prints and pre-review pre-prints; (3) We wander listlessly in vain search of catharsis from our latest rounds of savage CVPR rejections.