论文标题

参考游戏中语言和代理商的共同发展

Co-evolution of language and agents in referential games

论文作者

Dagan, Gautier, Hupkes, Dieuwke, Bruni, Elia

论文摘要

参考游戏为神经药物提供了基础的学习环境,这说明了语言在功能上用于交流的事实。但是,他们没有考虑到第二个约束,认为这是人类语言形状的基础:新语言学习者必须可以学习。 Cogswell等。 (2019年)通过不断变化的代理商在参考游戏中引入了文化传播,以限制新兴语言是可以学习的。但是,由此产生的语言仍然固有地受到代理的基本功能的偏见。 在这项工作中,我们介绍了语言传输引擎,以模拟一群代理商的文化和建筑发展。作为我们的核心贡献,我们从经验上表明,最佳情况是还要考虑语言学习者的学习偏见,从而让语言和代理人共同发展。当我们允许代理商人通过建筑进化而发展时,我们将在所有被考虑的指标上进行整体改进,并超过文化传播所取得的收益。这些结果强调了研究潜在的代理体系结构的重要性,并为研究语言出现研究中语言和代理的共同发展铺平了道路。

Referential games offer a grounded learning environment for neural agents which accounts for the fact that language is functionally used to communicate. However, they do not take into account a second constraint considered to be fundamental for the shape of human language: that it must be learnable by new language learners. Cogswell et al. (2019) introduced cultural transmission within referential games through a changing population of agents to constrain the emerging language to be learnable. However, the resulting languages remain inherently biased by the agents' underlying capabilities. In this work, we introduce Language Transmission Engine to model both cultural and architectural evolution in a population of agents. As our core contribution, we empirically show that the optimal situation is to take into account also the learning biases of the language learners and thus let language and agents co-evolve. When we allow the agent population to evolve through architectural evolution, we achieve across the board improvements on all considered metrics and surpass the gains made with cultural transmission. These results stress the importance of studying the underlying agent architecture and pave the way to investigate the co-evolution of language and agent in language emergence studies.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源