论文标题

将人工智能付款:在医疗保健中提供可信赖的AI的挑战

Holding AI to Account: Challenges for the Delivery of Trustworthy AI in Healthcare

论文作者

Procter, Rob, Tolmie, Peter, Rouncefield, Mark

论文摘要

现在,对A​​I系统为其行为提供解释的需求现在已被广泛认为是其采用的关键。在本文中,我们研究了值得信赖的AI的问题,并探讨了在实践中提供的意义,重点是医疗保健应用。在该领域的工作通常将可信赖的AI视为涉及单个用户和AI系统的人类计算机互动问题。但是,我们在这里认为,这忽略了组织问责制在社会技术环境中的推理和信任AI方面所扮演的重要角色。为了说明组织问责制的重要性,我们从多学科团队会议中对乳腺癌筛查和癌症治疗计划的民族志研究提出了结果,以表明参与者如何使自己彼此责任,并向其成员的组织负责。我们使用这些发现来丰富对值得信赖的AI要求的现有理解,并概述一些候选解决方案,以使AI对单个用户和组织性负责。最后,我们概述了这对未来工作对值得信赖的AI发展的影响,包括在不同的应用程序环境中重新使用我们建议的解决方案的方式。

The need for AI systems to provide explanations for their behaviour is now widely recognised as key to their adoption. In this paper, we examine the problem of trustworthy AI and explore what delivering this means in practice, with a focus on healthcare applications. Work in this area typically treats trustworthy AI as a problem of Human-Computer Interaction involving the individual user and an AI system. However, we argue here that this overlooks the important part played by organisational accountability in how people reason about and trust AI in socio-technical settings. To illustrate the importance of organisational accountability, we present findings from ethnographic studies of breast cancer screening and cancer treatment planning in multidisciplinary team meetings to show how participants made themselves accountable both to each other and to the organisations of which they are members. We use these findings to enrich existing understandings of the requirements for trustworthy AI and to outline some candidate solutions to the problems of making AI accountable both to individual users and organisationally. We conclude by outlining the implications of this for future work on the development of trustworthy AI, including ways in which our proposed solutions may be re-used in different application settings.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源