论文标题

重新识别的多域对抗特征概括

Multi-Domain Adversarial Feature Generalization for Person Re-Identification

论文作者

Lin, Shan, Li, Chang-Tsun, Kot, Alex C.

论文摘要

在应用于单个标记数据集的复杂培训方法的帮助下,近年来,完全监督人员的重新识别(人重新ID)的表现得到了显着改善。但是,这些模型在单个数据集上训练的模型通常将其应用于其他相机网络的视频时,通常会出现大量性能降解。为了使人员重新ID系统更加实用和可扩展,已经提出了几种跨数据库适应方法,这些方法在没有目标域的标记数据的情况下实现了高性能。但是,这些方法仍然需要训练过程中目标域的未标记数据,使其不切实际。在其他数据集上进行训练的实用人员重新ID系统应在新站点上部署后立即开始运行,而不必等到收集足够的图像或视频并收集预训练的模型。为了实现这一目的,在本文中,我们将重新识别为多数据域概括问题的人重新识别。我们提出了一个多数据集特征泛化网络(MMFA-AAE),该网络能够从多个标记的数据集中学习通用域不变的特征表示形式,并将其推广到“看不见”的摄像头系统。该网络基于对抗性自动编码器,以学习具有最大平均差异(MMD)度量的广义域,不变的潜在特征表示,以使跨多个域的分布对齐。广泛的实验证明了该方法的有效性。我们的MMFA-AAE方法不仅优于大多数域概括人重新ID方法,而且还超过了许多最先进的监督方法和无监督的域适应方法。

With the assistance of sophisticated training methods applied to single labeled datasets, the performance of fully-supervised person re-identification (Person Re-ID) has been improved significantly in recent years. However, these models trained on a single dataset usually suffer from considerable performance degradation when applied to videos of a different camera network. To make Person Re-ID systems more practical and scalable, several cross-dataset domain adaptation methods have been proposed, which achieve high performance without the labeled data from the target domain. However, these approaches still require the unlabeled data of the target domain during the training process, making them impractical. A practical Person Re-ID system pre-trained on other datasets should start running immediately after deployment on a new site without having to wait until sufficient images or videos are collected and the pre-trained model is tuned. To serve this purpose, in this paper, we reformulate person re-identification as a multi-dataset domain generalization problem. We propose a multi-dataset feature generalization network (MMFA-AAE), which is capable of learning a universal domain-invariant feature representation from multiple labeled datasets and generalizing it to `unseen' camera systems. The network is based on an adversarial auto-encoder to learn a generalized domain-invariant latent feature representation with the Maximum Mean Discrepancy (MMD) measure to align the distributions across multiple domains. Extensive experiments demonstrate the effectiveness of the proposed method. Our MMFA-AAE approach not only outperforms most of the domain generalization Person Re-ID methods, but also surpasses many state-of-the-art supervised methods and unsupervised domain adaptation methods by a large margin.

扫码加入交流群

加入微信交流群

微信交流群二维码

扫码加入学术交流群,获取更多资源