论文标题
Pamtri:使用高度随机的合成数据,用于重新识别车辆的姿势意识到的多任务学习
PAMTRI: Pose-Aware Multi-Task Learning for Vehicle Re-Identification Using Highly Randomized Synthetic Data
论文作者
论文摘要
与在研究社区进行了广泛研究的人员重新识别(REID)相比,Reid受到了较少的关注。车辆REID由于1)高层内变异性(由于形状和外观对视点的依赖性而引起的)和2)较小的阶层变异性(由不同制造商产生的车辆之间的相似性和外观引起)。为了应对这些挑战,我们提出了一个姿势感知的多任务重新确定(PAMTRI)框架。与以前的方法相比,这种方法包括两项创新。首先,它通过通过姿势估计中的关键点,热图和段来明确推理对车辆姿势和形状的明确推理来克服观点的依赖性。其次,它通过嵌入式姿势表示,在执行REID时共同对语义工具属性(颜色和类型)进行了分类。由于用详细的姿势和属性信息手动标记图像的标签非常令人震惊,因此我们创建了一个高度随机的合成数据集,并具有自动注释的车辆属性以进行训练。广泛的实验验证了每个提出的组件的有效性,表明Pamtri在两个主流车辆REID基准的最新基准中取得了显着改善:Veri和CityFlow-Reid。代码和型号可在https://github.com/nvlabs/pamtri上找到。
In comparison with person re-identification (ReID), which has been widely studied in the research community, vehicle ReID has received less attention. Vehicle ReID is challenging due to 1) high intra-class variability (caused by the dependency of shape and appearance on viewpoint), and 2) small inter-class variability (caused by the similarity in shape and appearance between vehicles produced by different manufacturers). To address these challenges, we propose a Pose-Aware Multi-Task Re-Identification (PAMTRI) framework. This approach includes two innovations compared with previous methods. First, it overcomes viewpoint-dependency by explicitly reasoning about vehicle pose and shape via keypoints, heatmaps and segments from pose estimation. Second, it jointly classifies semantic vehicle attributes (colors and types) while performing ReID, through multi-task learning with the embedded pose representations. Since manually labeling images with detailed pose and attribute information is prohibitive, we create a large-scale highly randomized synthetic dataset with automatically annotated vehicle attributes for training. Extensive experiments validate the effectiveness of each proposed component, showing that PAMTRI achieves significant improvement over state-of-the-art on two mainstream vehicle ReID benchmarks: VeRi and CityFlow-ReID. Code and models are available at https://github.com/NVlabs/PAMTRI.