论文标题
探索AI工程可用危害分析过程的机会
Exploring Opportunities in Usable Hazard Analysis Processes for AI Engineering
论文作者
论文摘要
将人工智能嵌入到系统中为现代工程实践带来了重大挑战。危害分析工具和过程尚未适应新的范式。本文介绍了有关AI相关危害分析中的当前实践以及用于进行这项工作的工具的初步研究和发现。我们最初的研究的目标是更好地了解从业者的需求，以及考虑对AI支持的产品和服务的危害和风险的新兴挑战。我们的主要研究问题是：我们是否可以开发新的结构化思维方法和系统工程工具来支持有效和引人入胜的方法，以预先考虑AI系统中的故障模式？我们对文献综述的初步发现以及对从业者的访谈强调了将危害分析整合到现代AI开发过程中的各种挑战，并提出了探索可用的，以人为中心的危害分析工具的机会。
Embedding artificial intelligence into systems introduces significant challenges to modern engineering practices. Hazard analysis tools and processes have not yet been adequately adapted to the new paradigm. This paper describes initial research and findings regarding current practices in AI-related hazard analysis and on the tools used to conduct this work. Our goal with this initial research is to better understand the needs of practitioners and the emerging challenges of considering hazards and risks for AI-enabled products and services. Our primary research question is: Can we develop new structured thinking methods and systems engineering tools to support effective and engaging ways for preemptively considering failure modes in AI systems? The preliminary findings from our review of the literature and interviews with practitioners highlight various challenges around integrating hazard analysis into modern AI development processes and suggest opportunities for exploration of usable, human-centered hazard analysis tools.
