论文标题
提高域自适应检测变压器的可传递性
Improving Transferability for Domain Adaptive Detection Transformers
论文作者
论文摘要
DETR风格的检测器在内域场景中脱颖而出，但是它们在域移位设置中的属性却没有探索。本文旨在基于两个发现，在域移位设置上建立一个简单但有效的基线。首先，减轻骨干上的域移动，解码器输出功能在获得有利的结果方面表现出色。对于另一种高级域对准方法，这两个部分都进一步增强了性能。因此，我们提出了对象感知对准（OAA）模块和最佳基于运输的对准（OTA）模块，以实现骨干和检测器输出的全面域对齐。 OAA模块将伪标签标识的前景区域对齐骨干输出中的伪标签，从而导致基于域的不变特征。 OTA模块利用切成薄片的Wasserstein距离来最大化位置信息的保留，同时最大程度地减少解码器输出中的域间隙。我们将调查结果和对齐模块实施到我们的适应方法中，并在域移位设置上基准测试了DETR风格的检测器。在各种领域自适应场景上的实验验证了我们方法的有效性。
DETR-style detectors stand out amongst in-domain scenarios, but their properties in domain shift settings are under-explored. This paper aims to build a simple but effective baseline with a DETR-style detector on domain shift settings based on two findings. For one, mitigating the domain shift on the backbone and the decoder output features excels in getting favorable results. For another, advanced domain alignment methods in both parts further enhance the performance. Thus, we propose the Object-Aware Alignment (OAA) module and the Optimal Transport based Alignment (OTA) module to achieve comprehensive domain alignment on the outputs of the backbone and the detector. The OAA module aligns the foreground regions identified by pseudo-labels in the backbone outputs, leading to domain-invariant based features. The OTA module utilizes sliced Wasserstein distance to maximize the retention of location information while minimizing the domain gap in the decoder outputs. We implement the findings and the alignment modules into our adaptation method, and it benchmarks the DETR-style detector on the domain shift settings. Experiments on various domain adaptive scenarios validate the effectiveness of our method.
