论文标题
使用RGB-D摄像头识别和定位指向手势
Recognition and Localisation of Pointing Gestures using a RGB-D Camera
论文作者
论文摘要
非语言交流是我们常规对话的一部分，并且使用多个手势来交换信息。在这些手势中，指向是最重要的。如果其他团队成员无法感知此类手势，例如由于盲人和视力障碍的人（BVIP），他们缺乏重要的信息，几乎无法参与活泼的工作流程。因此，本文介绍了一种用于检测此类指向手势的系统，以提供用于BVIP的合适输出方式的输入。我们的系统采用RGB-D摄像头来识别用户执行的指向手势。该系统还定位指向的目标在一个共同的工作空间上。我们通过与26个用户进行用户研究来评估系统。结果表明，对于2 x 3矩阵的成功率分别为89.59和79.92％，使用左和右臂分别使用左和右臂的3 x 4矩阵，为73.57和68.99％。
Non-verbal communication is part of our regular conversation, and multiple gestures are used to exchange information. Among those gestures, pointing is the most important one. If such gestures cannot be perceived by other team members, e.g. by blind and visually impaired people (BVIP), they lack important information and can hardly participate in a lively workflow. Thus, this paper describes a system for detecting such pointing gestures to provide input for suitable output modalities to BVIP. Our system employs an RGB-D camera to recognize the pointing gestures performed by the users. The system also locates the target of pointing e.g. on a common workspace. We evaluated the system by conducting a user study with 26 users. The results show that the system has a success rate of 89.59 and 79.92 % for a 2 x 3 matrix using the left and right arm respectively, and 73.57 and 68.99 % for 3 x 4 matrix using the left and right arm respectively.
