论文标题

科学知识的犯罪防御平衡:发布AI研究是否减少了滥用?

The Offense-Defense Balance of Scientific Knowledge: Does Publishing AI Research Reduce Misuse?

论文作者

Shevlane, Toby, Dafoe, Allan

论文摘要

人们对人工智能(AI)研究的潜在滥用的关注日益关注。发表科学研究可以促进滥用该技术,但该研究也可以有助于保护滥用。本文解决了这两种效果之间的平衡。我们的理论框架阐明了有关发表研究的因素是否对攻击者或捍卫者更有用,例如有足够的防御措施或独立发现科学界以外的知识的可能性。在科学领域的平衡将有所不同。但是,我们表明,AI中的现有对话已从计算机安全性披露软件漏洞的情况下导入了概念和结论。尽管披露软件漏洞通常会有利于防御,但对于AI研究而言,这不能假定。 AI研究社区应考虑来自广泛的相邻领域的概念和政策,并最终需要制定非常适合其特定挑战的政策。

There is growing concern over the potential misuse of artificial intelligence (AI) research. Publishing scientific research can facilitate misuse of the technology, but the research can also contribute to protections against misuse. This paper addresses the balance between these two effects. Our theoretical framework elucidates the factors governing whether the published research will be more useful for attackers or defenders, such as the possibility for adequate defensive measures, or the independent discovery of the knowledge outside of the scientific community. The balance will vary across scientific fields. However, we show that the existing conversation within AI has imported concepts and conclusions from prior debates within computer security over the disclosure of software vulnerabilities. While disclosure of software vulnerabilities often favours defence, this cannot be assumed for AI research. The AI research community should consider concepts and policies from a broad set of adjacent fields, and ultimately needs to craft policy well-suited to its particular challenges.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源