论文标题

Roth-Erev和神经代理人的学习构成否定

Learning Compositional Negation in Populations of Roth-Erev and Neural Agents

论文作者

Todd, Graham, Steinert-Threlkeld, Shane, Potts, Christopher

论文摘要

基于代理的模型和信号游戏是在可拖动环境中研究语言交流的出现的有用工具。这些技术已被用来研究自然语言的组成性能,但是它们在对真实沟通者建模的程度上受到限制。在这项工作中,我们介绍了经典信号游戏的新颖变体,该变体探讨了简单的构图规则有关否定的可学习性。该方法基于Steinert-Threlkeld(2016)的工作,允许代理商确定代表否定的“函数词”的身份,同时学习为原子符号分配含义。我们通过引入同时交流代理的人群进行扩展分析,并探索较大的人口规模带来的并发症如何影响信号系统所学的类型和稳定性。我们还放宽了学习剂的参数形式的假设,并研究了通过强化学习在各种任务设置下进行优化的基于神经网络的代理。我们发现,在广泛的模型放松和试剂实例化中,基本的组成特性是可靠的。

Agent-based models and signalling games are useful tools with which to study the emergence of linguistic communication in a tractable setting. These techniques have been used to study the compositional property of natural languages, but have been limited in how closely they model real communicators. In this work, we present a novel variant of the classic signalling game that explores the learnability of simple compositional rules concerning negation. The approach builds on the work of Steinert-Threlkeld (2016) by allowing agents to determine the identity of the "function word" representing negation while simultaneously learning to assign meanings to atomic symbols. We extend the analysis with the introduction of a population of concurrently communicating agents, and explore how the complications brought about by a larger population size affect the type and stability of the signalling systems learned. We also relax assumptions of the parametric form of the learning agents and examine how neural network-based agents optimized through reinforcement learning behave under various task settings. We find that basic compositional properties are robustly learnable across a wide range of model relaxations and agent instantiations.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源