论文标题

关节进程:基于步态图卷积网络和关节关系金字塔映射的基于模型的步态识别方法

JointsGait:A model-based Gait Recognition Method based on Gait Graph Convolutional Networks and Joints Relationship Pyramid Mapping

论文作者

Li, Na, Zhao, Xinbo, Ma, Chong

论文摘要

作为独特的生物特征特征之一,步态具有从长距离之外识别的优势,可以广泛用于公共安全。考虑到3D姿势估计比实践中的2D姿势估计更具挑战性,我们研究使用2D关节在本文中识别步态,并且提出了一种新的基于模型的步态识别方法关节,以从2D人体关节中提取步态信息。基于外观的步态识别算法是普遍的。但是,外观特征遭受了可能导致外观急剧变化的外部因素,例如衣服。与以前的方法不同,联合进度首先使用步态图卷积网络从2D接头提取时空特征,而外部因素的干扰较少。其次,提出了关节关系金字塔映射(JRPM)将时空步态特征映射到一个判别特征空间中,并根据人们在各种规模行走时人类关节的关系具有生物学优势。最后,我们设计了一种融合损失策略,以帮助关节功能对跨视图不敏感。我们的方法在两个大型数据集上进行评估,即Kinect步态生物图数据集和CASIA-B。在Kinect步态生物测量数据集数据库上,关节数据仅使用相应的关节2D坐标,但是与使用3D关节的基于模型的算法相比,与那些基于模型的算法相比,达到了令人满意的识别精度。在CASIA-B数据库中,提出的方法在所有步行条件下都大大优于基于高级模型的方法,甚至在服装严重影响人们的外观时,甚至在基于外观的最新外观方法上都表现出色。实验结果表明,尽管尺寸较低(2D主体接头),但关节差仍能达到最先进的性能,并且受视图变化和衣服变化的影响较小。

Gait, as one of unique biometric features, has the advantage of being recognized from a long distance away, can be widely used in public security. Considering 3D pose estimation is more challenging than 2D pose estimation in practice , we research on using 2D joints to recognize gait in this paper, and a new model-based gait recognition method JointsGait is put forward to extract gait information from 2D human body joints. Appearance-based gait recognition algorithms are prevalent before. However, appearance features suffer from external factors which can cause drastic appearance variations, e.g. clothing. Unlike previous approaches, JointsGait firstly extracted spatio-temporal features from 2D joints using gait graph convolutional networks, which are less interfered by external factors. Secondly, Joints Relationship Pyramid Mapping (JRPM) are proposed to map spatio-temporal gait features into a discriminative feature space with biological advantages according to the relationship of human joints when people are walking at various scales. Finally, we design a fusion loss strategy to help the joints features to be insensitive to cross-view. Our method is evaluated on two large datasets, Kinect Gait Biometry Dataset and CASIA-B. On Kinect Gait Biometry Dataset database, JointsGait only uses corresponding 2D coordinates of joints, but achieves satisfactory recognition accuracy compared with those model-based algorithms using 3D joints. On CASIA-B database, the proposed method greatly outperforms advanced model-based methods in all walking conditions, even performs superior to state-of-art appearance-based methods when clothing seriously affect people's appearance. The experimental results demonstrate that JointsGait achieves the state-of-art performance despite the low dimensional feature (2D body joints) and is less affected by the view variations and clothing variation.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源