论文标题
面对逆境的乐观情绪:通过对抗性鲁棒性理解和改善深度学习
Optimism in the Face of Adversity: Understanding and Improving Deep Learning through Adversarial Robustness
论文作者
论文摘要
在大量数据和计算资源的重要进展的推动下,新的深度学习系统在大量应用中取得了出色的成果。然而,我们目前对深度学习的数学基础的理论理解远远落后于其经验成功。然而,为了解决神经网络的脆弱性,对抗性鲁棒性的领域最近已成为我们深层模型的解释的主要来源之一。在本文中,我们对深度学习中对抗性鲁棒性领域进行了深入的评论,并对其主要概念进行了独立的介绍。但是,与对抗性鲁棒性的主流悲观观点相反,我们专注于它所带来的主要积极方面。我们强调了对抗性示例与深度神经网络的几何形状之间的直观联系,并最终探讨了对抗性示例的几何研究如何成为了解深度学习的有力工具。此外,我们证明了对抗性鲁棒性的广泛适用性,概述了超越安全性的对抗性鲁棒性的主要新兴应用。本文的目的是为读者提供一系列新观点,以了解深度学习,并为他们提供有关如何使用对抗性鲁棒性改善它的直观工具和见解。
Driven by massive amounts of data and important advances in computational resources, new deep learning systems have achieved outstanding results in a large spectrum of applications. Nevertheless, our current theoretical understanding on the mathematical foundations of deep learning lags far behind its empirical success. Towards solving the vulnerability of neural networks, however, the field of adversarial robustness has recently become one of the main sources of explanations of our deep models. In this article, we provide an in-depth review of the field of adversarial robustness in deep learning, and give a self-contained introduction to its main notions. But, in contrast to the mainstream pessimistic perspective of adversarial robustness, we focus on the main positive aspects that it entails. We highlight the intuitive connection between adversarial examples and the geometry of deep neural networks, and eventually explore how the geometric study of adversarial examples can serve as a powerful tool to understand deep learning. Furthermore, we demonstrate the broad applicability of adversarial robustness, providing an overview of the main emerging applications of adversarial robustness beyond security. The goal of this article is to provide readers with a set of new perspectives to understand deep learning, and to supply them with intuitive tools and insights on how to use adversarial robustness to improve it.