论文标题
积极教学的直觉
Intuitiveness in Active Teaching
论文作者
论文摘要
尽管机器学习在自动化系统中产生了惊人的结果,但通常以大量数据要求为代价。这使许多成功的算法来自机器学习不适合人机互动,该机器必须在合理的时间范围内通过用户可以提供的少量培训样本学习。幸运的是,用户可以量身定制其创建的培训数据,以尽可能有用,严重限制其必要的大小 - 只要他们知道机器的要求和限制即可。当然,获取这些知识反过来又可能繁琐且昂贵。这就提出了一个问题,即机器学习算法与与之互动的互动方式。在这项工作中,我们通过分析某些算法的直觉在由用户积极教授时来解决此问题。在开发了直觉的理论框架作为算法的属性之后,我们引入了一种积极的教学范式,该教学范式涉及一项典型的二维空间学习任务,作为一种判断人机相互作用功效的方法。最后,我们介绍并讨论了对800种用户与我们系统中的两种著名的机器学习算法进行互动的性能和教学策略的大规模用户研究的结果,这为直觉作为影响人机相互作用的重要因素的作用提供了第一个证据。
While Machine learning gives rise to astonishing results in automated systems, it is usually at the cost of large data requirements. This makes many successful algorithms from machine learning unsuitable for human-machine interaction, where the machine must learn from a small number of training samples that can be provided by a user within a reasonable time frame. Fortunately, the user can tailor the training data they create to be as useful as possible, severely limiting its necessary size -- as long as they know about the machine's requirements and limitations. Of course, acquiring this knowledge can in turn be cumbersome and costly. This raises the question of how easy machine learning algorithms are to interact with. In this work, we address this issue by analyzing the intuitiveness of certain algorithms when they are actively taught by users. After developing a theoretical framework of intuitiveness as a property of algorithms, we introduce an active teaching paradigm involving a prototypical two-dimensional spatial learning task as a method to judge the efficacy of human-machine interactions. Finally, we present and discuss the results of a large-scale user study into the performance and teaching strategies of 800 users interacting with two prominent machine learning algorithms in our system, providing first evidence for the role of intuition as an important factor impacting human-machine interaction.