论文标题
有效的尖峰神经网络,用于在Loihi神经形态处理器上使用DVS摄像头识别手势
An Efficient Spiking Neural Network for Recognizing Gestures with a DVS Camera on the Loihi Neuromorphic Processor
论文作者
论文摘要
与传统的人工深度神经网络(DNN)相比,由于其基于机器学习的应用程序(SNN),第三代NNS(SNNS),由于其生物学上的合理性和复杂性降低,因此受到了基于机器学习的应用的关注。这些SNN可以在Intel Loihi Research Chip(例如DVS摄像机)等神经形态处理器(例如Intel Loihi Research Chip)等神经形态处理器上实现极端的能效。但是,具有许多层的DNN可以在图像分类和识别任务上达到相对较高的精度,因为对现实世界应用程序的SNN的学习规则的研究仍然无法成熟。 SNN的精度结果通常是通过将训练的DNN转换为SNN的,或通过直接在峰值域中设计和训练SNN来获得的。为了从DNN转换为SNN,我们对此类过程进行了全面的分析,该过程专门为Intel Loihi设计,展示了我们设计的SNN设计方法,该方法与相应的DNN相同。为了使用基于事件的传感器,我们设计了一种针对DVSGENTURE数据集进行评估的预处理方法,这使得可以在DNN域中使用。因此,基于首次分析的结果,我们为预处理的DVSGEMTURE数据集训练DNN,并将其转换为Spike域,以在Intel Loihi上部署,从而实现实时手势识别。结果表明,我们的SNN达到了89.64%的分类准确性,仅占37个Loihi内核。用于生成我们实验的源代码可在https://github.com/albertomarchisio/efficientsnn在线获得。
Spiking Neural Networks (SNNs), the third generation NNs, have come under the spotlight for machine learning based applications due to their biological plausibility and reduced complexity compared to traditional artificial Deep Neural Networks (DNNs). These SNNs can be implemented with extreme energy efficiency on neuromorphic processors like the Intel Loihi research chip, and fed by event-based sensors, such as DVS cameras. However, DNNs with many layers can achieve relatively high accuracy on image classification and recognition tasks, as the research on learning rules for SNNs for real-world applications is still not mature. The accuracy results for SNNs are typically obtained either by converting the trained DNNs into SNNs, or by directly designing and training SNNs in the spiking domain. Towards the conversion from a DNN to an SNN, we perform a comprehensive analysis of such process, specifically designed for Intel Loihi, showing our methodology for the design of an SNN that achieves nearly the same accuracy results as its corresponding DNN. Towards the usage of the event-based sensors, we design a pre-processing method, evaluated for the DvsGesture dataset, which makes it possible to be used in the DNN domain. Hence, based on the outcome of the first analysis, we train a DNN for the pre-processed DvsGesture dataset, and convert it into the spike domain for its deployment on Intel Loihi, which enables real-time gesture recognition. The results show that our SNN achieves 89.64% classification accuracy and occupies only 37 Loihi cores. The source code for generating our experiments is available online at https://github.com/albertomarchisio/EfficientSNN.