论文标题
解剖学引导的结构域适应3D内床的姿势估计
Anatomy-guided domain adaptation for 3D in-bed human pose estimation
论文作者
论文摘要
3D人姿势估计是临床监测系统的关键组成部分。但是,深层姿势估计模型的临床适用性受到域转移下的概括不良的限制,以及它们需要足够标记的训练数据。作为一种补救措施,我们提出了一种新型的域适应方法,将模型从标记的来源调整为移动的未标记目标域。我们的方法包括基于有关人解剖学的先验知识的两种互补适应策略。首先,我们通过将预测限制为解剖上合理的姿势的空间来指导目标领域中的学习过程。为此,我们将先验知识嵌入到解剖损失函数中,该函数会惩罚不对称的肢体长度,难以置信的骨长和令人难以置信的关节角度。其次,我们建议根据其解剖学的合理性过滤伪标签,以进行自我训练,并将概念纳入平均教师范式中。我们将这两种策略统一在适用于无监督和无源领域适应的基于云的框架中。使用公共SLP数据集和一个新创建的数据集,在两个适应方案下对床内姿势估算进行评估。我们的方法始终优于各种最新的域适应方法,超过基线模型31%/66%,并将域间隙降低65%/82%。源代码可从https://github.com/multimodallearning/da-3dhpe-anatomy获得。
3D human pose estimation is a key component of clinical monitoring systems. The clinical applicability of deep pose estimation models, however, is limited by their poor generalization under domain shifts along with their need for sufficient labeled training data. As a remedy, we present a novel domain adaptation method, adapting a model from a labeled source to a shifted unlabeled target domain. Our method comprises two complementary adaptation strategies based on prior knowledge about human anatomy. First, we guide the learning process in the target domain by constraining predictions to the space of anatomically plausible poses. To this end, we embed the prior knowledge into an anatomical loss function that penalizes asymmetric limb lengths, implausible bone lengths, and implausible joint angles. Second, we propose to filter pseudo labels for self-training according to their anatomical plausibility and incorporate the concept into the Mean Teacher paradigm. We unify both strategies in a point cloud-based framework applicable to unsupervised and source-free domain adaptation. Evaluation is performed for in-bed pose estimation under two adaptation scenarios, using the public SLP dataset and a newly created dataset. Our method consistently outperforms various state-of-the-art domain adaptation methods, surpasses the baseline model by 31%/66%, and reduces the domain gap by 65%/82%. Source code is available at https://github.com/multimodallearning/da-3dhpe-anatomy.