论文标题
纸张评估器作业应依赖哪些因素？社区对会议同行评审的问题和理想的看法
What Factors Should Paper-Reviewer Assignments Rely On? Community Perspectives on Issues and Ideals in Conference Peer-Review
论文作者
论文摘要
科学进步和个人研究人员职业都取决于同行评审的质量，这又取决于纸质评论者的匹配。出人意料的是，这个问题主要是作为自动推荐问题解决的，而不是在不同的利益相关者（区域椅子，审阅者，作者）中积累了值得考虑的经验。我们介绍了NLP社区的首次调查的结果，确定了纸质评论器匹配系统应考虑哪些因素的常见问题和观点。这项研究为改善未来的NLP会议提供了可行的建议，并为可解释的同行评审任务提供了应有的建议。
Both scientific progress and individual researcher careers depend on the quality of peer review, which in turn depends on paper-reviewer matching. Surprisingly, this problem has been mostly approached as an automated recommendation problem rather than as a matter where different stakeholders (area chairs, reviewers, authors) have accumulated experience worth taking into account. We present the results of the first survey of the NLP community, identifying common issues and perspectives on what factors should be considered by paper-reviewer matching systems. This study contributes actionable recommendations for improving future NLP conferences, and desiderata for interpretable peer review assignments.
