论文标题
具有可学习的图形结构和自适应AU的几何图表示,用于微表达识别
Geometric Graph Representation with Learnable Graph Structure and Adaptive AU Constraint for Micro-Expression Recognition
论文作者
论文摘要
微表达识别(MER)是有价值的,因为微表达(MES)可以揭示真正的情绪。大多数作品将图像序列作为输入,无法有效地探索我的信息,因为与我相关的微妙动作很容易被淹没在无关的信息中。取而代之的是,面部地标是一种低维且紧凑的模态,可实现较低的计算成本,并有可能集中于与ME相关的运动特征。但是,尚不清楚面部地标的面部地标的可区分性。因此,本文探讨了面部地标的贡献,并提出了一个新颖的框架,以有效地识别MES。首先,构建了几何两流图网络,以从面部地标汇总低阶和高阶几何运动信息,以获得歧视性ME表示。其次,引入了一种自学方式,以自动建模节点之间的动态关系,甚至是长距离节点。此外,提出了一种自适应行动单位损失,以合理地建立地标,面部动作单元和ME之间的牢固相关性。值得注意的是,这项工作提供了一个新颖的想法,其效率要高得多,仅利用基于图的几何特征。实验结果表明,所提出的方法通过大大降低的计算成本来实现竞争性能。此外,面部地标显着有助于MER,值得进一步研究高效的ME分析。
Micro-expression recognition (MER) is valuable because micro-expressions (MEs) can reveal genuine emotions. Most works take image sequences as input and cannot effectively explore ME information because subtle ME-related motions are easily submerged in unrelated information. Instead, the facial landmark is a low-dimensional and compact modality, which achieves lower computational cost and potentially concentrates on ME-related movement features. However, the discriminability of facial landmarks for MER is unclear. Thus, this paper explores the contribution of facial landmarks and proposes a novel framework to efficiently recognize MEs. Firstly, a geometric two-stream graph network is constructed to aggregate the low-order and high-order geometric movement information from facial landmarks to obtain discriminative ME representation. Secondly, a self-learning fashion is introduced to automatically model the dynamic relationship between nodes even long-distance nodes. Furthermore, an adaptive action unit loss is proposed to reasonably build the strong correlation between landmarks, facial action units and MEs. Notably, this work provides a novel idea with much higher efficiency to promote MER, only utilizing graph-based geometric features. The experimental results demonstrate that the proposed method achieves competitive performance with a significantly reduced computational cost. Furthermore, facial landmarks significantly contribute to MER and are worth further study for high-efficient ME analysis.