论文标题
学习执行行动或提出澄清问题
Learning to Execute Actions or Ask Clarification Questions
论文作者
论文摘要
协作任务是无处不在的活动，在这些活动中，需要一种交流形式才能达到共同的目标。协作建筑就是这样的任务之一。我们希望在模拟的建筑环境（Minecraft）中开发智能建筑商代理，该代理可以通过与代理商进行交谈来构建任何想要构建的用户。为了实现这一目标，此类代理需要能够在需要进一步的信息时提出澄清问题来主动。 Minecraft Copus数据集上的现有作品只会学会执行指令，忽略了要求澄清的重要性。在本文中，我们通过将所有构建器的话语注释为八种类型，包括澄清问题，并提出一个能够确定何时询问或执行指令的新构建器代理模型来扩展Minecraft Copus数据集。实验结果表明，我们的模型在协作建筑任务上实现了最先进的绩效，并取得了重大改进。我们还定义了两个新任务，即询问任务和联合学习任务的学习。后者包括解决合作建筑物和学习共同询问任务的组成。
Collaborative tasks are ubiquitous activities where a form of communication is required in order to reach a joint goal. Collaborative building is one of such tasks. We wish to develop an intelligent builder agent in a simulated building environment (Minecraft) that can build whatever users wish to build by just talking to the agent. In order to achieve this goal, such agents need to be able to take the initiative by asking clarification questions when further information is needed. Existing works on Minecraft Corpus Dataset only learn to execute instructions neglecting the importance of asking for clarifications. In this paper, we extend the Minecraft Corpus Dataset by annotating all builder utterances into eight types, including clarification questions, and propose a new builder agent model capable of determining when to ask or execute instructions. Experimental results show that our model achieves state-of-the-art performance on the collaborative building task with a substantial improvement. We also define two new tasks, the learning to ask task and the joint learning task. The latter consists of solving both collaborating building and learning to ask tasks jointly.
