论文标题
通过热成像进行运动和区域知识的对抗学习以进行秋季检测
Motion and Region Aware Adversarial Learning for Fall Detection with Thermal Imaging
论文作者
论文摘要
自动秋季检测是确保人们健康和安全的重要技术。秋季检测的家庭摄像头系统通常会使人们的隐私处于危险之中。热摄像机可以部分或完全混淆面部特征,从而保留一个人的隐私。另一个挑战是,与日常生活的正常活动相比,跌倒的发生率较小。由于秋季很少发生,由于阶级失衡,学习算法是不算平的。为了解决这些问题,我们使用热成像在对抗框架内提出秋季检测为一种异常检测。我们提出了一个新型的对抗网络,该网络由两通道3D卷积自动编码器组成,分别重建热数据和光流输入序列。我们引入了一种跟踪感兴趣区域的技术,基于区域的差异约束以及一个关节歧视者来计算重建误差。较大的重建误差表明发生跌落。与标准基线相比,公开可用的热下秋季数据集的实验显示了获得的优越结果。
Automatic fall detection is a vital technology for ensuring the health and safety of people. Home-based camera systems for fall detection often put people's privacy at risk. Thermal cameras can partially or fully obfuscate facial features, thus preserving the privacy of a person. Another challenge is the less occurrence of falls in comparison to the normal activities of daily living. As fall occurs rarely, it is non-trivial to learn algorithms due to class imbalance. To handle these problems, we formulate fall detection as an anomaly detection within an adversarial framework using thermal imaging. We present a novel adversarial network that comprises of two-channel 3D convolutional autoencoders which reconstructs the thermal data and the optical flow input sequences respectively. We introduce a technique to track the region of interest, a region-based difference constraint, and a joint discriminator to compute the reconstruction error. A larger reconstruction error indicates the occurrence of a fall. The experiments on a publicly available thermal fall dataset show the superior results obtained compared to the standard baseline.