论文标题
3D人网构建利用Wi-Fi
3D Human Mesh Construction Leveraging Wi-Fi
论文作者
论文摘要
在本文中,我们介绍了Wi-Mesh,这是一种基于WiFi视觉的3D人网格构建系统。我们的系统利用WiFi的进步可视化3D网格结构的人体的形状和变形。特别是,它利用WiFi设备上的多次传输和接收天线来估计WiFi信号反射的二维到达角度(2D AOA),以使WiFi设备像我们人类一样能够看到物理环境。然后,它仅从物理环境中提取人体的图像,并利用深度学习模型将提取的人体数字化成3D网格表示。各种室内环境下的实验评估表明,Wi-mesh达到了2.81厘米的平均顶点位置误差,关节位置误差为2.4cm,这与利用专业和专用硬件的系统可比。拟议的系统具有重新使用潜在批量采用环境中已经存在的WiFi设备的优势。它还可以在视力(NLOS),较差的照明条件和宽松的衣服中起作用,基于相机的系统无法正常工作。
In this paper, we present, Wi-Mesh, a WiFi vision-based 3D human mesh construction system. Our system leverages the advances of WiFi to visualize the shape and deformations of the human body for 3D mesh construction. In particular, it leverages multiple transmitting and receiving antennas on WiFi devices to estimate the two-dimensional angle of arrival (2D AoA) of the WiFi signal reflections to enable WiFi devices to see the physical environment as we humans do. It then extracts only the images of the human body from the physical environment and leverages deep learning models to digitize the extracted human body into a 3D mesh representation. Experimental evaluation under various indoor environments shows that Wi-Mesh achieves an average vertices location error of 2.81cm and joint position error of 2.4cm, which is comparable to the systems that utilize specialized and dedicated hardware. The proposed system has the advantage of re-using the WiFi devices that already exist in the environment for potential mass adoption. It can also work in non-line of sight (NLoS), poor lighting conditions, and baggy clothes, where the camera-based systems do not work well.