论文标题
在RISC-V处理器上识别人类活动识别的超紧凑型二进制神经网络
Ultra-compact Binary Neural Networks for Human Activity Recognition on RISC-V Processors
论文作者
论文摘要
人类活动识别(HAR)是许多移动应用程序中的相关推理任务。在边缘的最先进的har通常是通过轻巧的机器学习模型(例如决策树和随机森林(RF)来实现的,而由于其高计算复杂性,深度学习不太常见。在这项工作中,我们提出了基于深层神经网络的HAR实施的新颖实施,正好基于二进制神经网络(BNN),以使用RISC-V指令集的低功率通用处理器为目标。由于替换了算术操作,BNN产生了很小的记忆足迹和低推理的复杂性。但是,现有在通用处理器上实现的BNN实现对复杂的计算机视觉任务施加了限制,这导致了过度的模型,例如HAR等简单问题。因此,我们还引入了一个新的BNN推理库,该库明确针对超紧凑模型。通过在单核RISC-V处理器上进行实验,我们表明,与基于RFS的最新基线相比,在两个HAR数据集中受过训练的BNN获得了更高的分类精度。此外,根据RF提取的功能的复杂性,我们的BNN达到了较少的记忆(最多91%)或更高的能源效率(最高70%)的RF的准确性。
Human Activity Recognition (HAR) is a relevant inference task in many mobile applications. State-of-the-art HAR at the edge is typically achieved with lightweight machine learning models such as decision trees and Random Forests (RFs), whereas deep learning is less common due to its high computational complexity. In this work, we propose a novel implementation of HAR based on deep neural networks, and precisely on Binary Neural Networks (BNNs), targeting low-power general purpose processors with a RISC-V instruction set. BNNs yield very small memory footprints and low inference complexity, thanks to the replacement of arithmetic operations with bit-wise ones. However, existing BNN implementations on general purpose processors impose constraints tailored to complex computer vision tasks, which result in over-parametrized models for simpler problems like HAR. Therefore, we also introduce a new BNN inference library, which targets ultra-compact models explicitly. With experiments on a single-core RISC-V processor, we show that BNNs trained on two HAR datasets obtain higher classification accuracy compared to a state-of-the-art baseline based on RFs. Furthermore, our BNN reaches the same accuracy of a RF with either less memory (up to 91%) or more energy-efficiency (up to 70%), depending on the complexity of the features extracted by the RF.