论文标题

您需要的就是您所需要的:稳态神经网络适应概念转移

Need is All You Need: Homeostatic Neural Networks Adapt to Concept Shift

论文作者

Man, Kingson, Damasio, Antonio, Neven, Hartmut

论文摘要

在生物体中,体内平衡是对旨在维持与生活兼容的条件的内部状态的自然调节。典型的人造系统不具备可比的调节功能。在这里,我们介绍了一个包含体内稳态功能的人工神经网络。它自己的计算基板与与其计算的对象相关的必要且脆弱的关系。例如,对MNIST数字或服装的时尚习惯进行分类的人工神经元可能会受到兴奋性或抑制作用,这会改变其自身的学习率,这是感知和分类数字的直接结果。在这种情况下,代理本身需要准确的识别,因为它指导决策以规范其脆弱的内部状态和功能。违反直觉,在学习者中增加脆弱性并不一定会损害其表现。相反,响应脆弱性的自我调节在某些条件下赋予了利益。我们表明,体内稳态设计赋予了概念转移的适应性提高,在概念转移中,标签和数据之间的关系随着时间的推移而变化,并且最大的优势是在最高的转移率下获得的。这需要对过去的关联的迅速学习和重新学习。我们还展示了稳态学习者在具有动态变化速度转移速率的环境中的优势能力。我们的体内稳态设计使人造神经网络的思维机械揭示了自己的“思想”的后果,这说明了将自己的“皮肤”放在游戏中以改善流体智能的优势。

In living organisms, homeostasis is the natural regulation of internal states aimed at maintaining conditions compatible with life. Typical artificial systems are not equipped with comparable regulatory features. Here, we introduce an artificial neural network that incorporates homeostatic features. Its own computing substrate is placed in a needful and vulnerable relation to the very objects over which it computes. For example, artificial neurons performing classification of MNIST digits or Fashion-MNIST articles of clothing may receive excitatory or inhibitory effects, which alter their own learning rate as a direct result of perceiving and classifying the digits. In this scenario, accurate recognition is desirable to the agent itself because it guides decisions to regulate its vulnerable internal states and functionality. Counterintuitively, the addition of vulnerability to a learner does not necessarily impair its performance. On the contrary, self-regulation in response to vulnerability confers benefits under certain conditions. We show that homeostatic design confers increased adaptability under concept shift, in which the relationships between labels and data change over time, and that the greatest advantages are obtained under the highest rates of shift. This necessitates the rapid un-learning of past associations and the re-learning of new ones. We also demonstrate the superior abilities of homeostatic learners in environments with dynamically changing rates of concept shift. Our homeostatic design exposes the artificial neural network's thinking machinery to the consequences of its own "thoughts", illustrating the advantage of putting one's own "skin in the game" to improve fluid intelligence.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源