论文标题

使用尖峰进行有效的处理和学习:多尖峰学习的新方法

Towards Efficient Processing and Learning with Spikes: New Approaches for Multi-Spike Learning

论文作者

Yu, Qiang, Li, Shenglan, Tang, Huajin, Wang, Longbiao, Dang, Jianwu, Tan, Kay Chen

论文摘要

尖峰是中枢神经系统中用于信息传输和处理的货币。还认为它们在生物系统的低功率消耗中起着至关重要的作用,它们的效率吸引了对神经形态计算领域的关注。但是,离散峰值的有效处理和学习仍然是一个具有挑战性的问题。在本文中,我们为这个方向做出了贡献。首先引入了简化的尖峰神经元模型,其突触输入和发射输出对用脉冲功能进行建模的膜电位的影响。然后提出一个事件驱动的方案,以进一步提高处理效率。基于神经元模型,我们提出了两个新的多尖峰学习规则,这些规则比其他基线在包括关联,分类,功能检测(功能检测)方面表现出更好的性能。除了效率外,我们的学习规则还证明了对不同类型的强噪声的高度鲁棒性。它们还可以推广到分类任务的不同尖峰编码方案,并且尤其是单个神经元能够通过我们的学习规则求解多类别分类。在功能检测任务中,我们重新检查了无监督的STDP的能力,其局限性正在提出,并找到了失去选择性的新现象。相比之下,我们提出的学习规则可以可靠地解决各种条件的任务,而无需应用特定的限制。此外,我们的规则不仅可以检测功能,还可以区分它们。我们方法的改善性能将有助于神经形态计算作为一种优选的选择。

Spikes are the currency in central nervous systems for information transmission and processing. They are also believed to play an essential role in low-power consumption of the biological systems, whose efficiency attracts increasing attentions to the field of neuromorphic computing. However, efficient processing and learning of discrete spikes still remains as a challenging problem. In this paper, we make our contributions towards this direction. A simplified spiking neuron model is firstly introduced with effects of both synaptic input and firing output on membrane potential being modeled with an impulse function. An event-driven scheme is then presented to further improve the processing efficiency. Based on the neuron model, we propose two new multi-spike learning rules which demonstrate better performance over other baselines on various tasks including association, classification, feature detection. In addition to efficiency, our learning rules demonstrate a high robustness against strong noise of different types. They can also be generalized to different spike coding schemes for the classification task, and notably single neuron is capable of solving multi-category classifications with our learning rules. In the feature detection task, we re-examine the ability of unsupervised STDP with its limitations being presented, and find a new phenomenon of losing selectivity. In contrast, our proposed learning rules can reliably solve the task over a wide range of conditions without specific constraints being applied. Moreover, our rules can not only detect features but also discriminate them. The improved performance of our methods would contribute to neuromorphic computing as a preferable choice.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源